-- Logs begin at Tue 2022-08-09 11:39:41 UTC, end at Tue 2022-08-09 12:36:47 UTC. -- Aug 09 12:07:53.653704 dv-cinder-852369-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 09 12:07:53.665245 dv-cinder-852369-1-smb devstack@keystone.service[80074]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 09 12:07:53.667225 dv-cinder-852369-1-smb devstack@keystone.service[80074]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 12:07:53 2022] *** Aug 09 12:07:53.667225 dv-cinder-852369-1-smb devstack@keystone.service[80074]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 12:07:53.667225 dv-cinder-852369-1-smb devstack@keystone.service[80074]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 12:07:53.667225 dv-cinder-852369-1-smb devstack@keystone.service[80074]: nodename: dv-cinder-852369-1-smb Aug 09 12:07:53.667225 dv-cinder-852369-1-smb devstack@keystone.service[80074]: machine: x86_64 Aug 09 12:07:53.667225 dv-cinder-852369-1-smb devstack@keystone.service[80074]: clock source: unix Aug 09 12:07:53.667225 dv-cinder-852369-1-smb devstack@keystone.service[80074]: pcre jit disabled Aug 09 12:07:53.667225 dv-cinder-852369-1-smb devstack@keystone.service[80074]: detected number of CPU cores: 4 Aug 09 12:07:53.667225 dv-cinder-852369-1-smb devstack@keystone.service[80074]: current working directory: / Aug 09 12:07:53.667225 dv-cinder-852369-1-smb devstack@keystone.service[80074]: detected binary path: /usr/bin/uwsgi-core Aug 09 12:07:53.667754 dv-cinder-852369-1-smb devstack@keystone.service[80074]: your processes number limit is 47680 Aug 09 12:07:53.667754 dv-cinder-852369-1-smb devstack@keystone.service[80074]: your memory page size is 4096 bytes Aug 09 12:07:53.667754 dv-cinder-852369-1-smb devstack@keystone.service[80074]: detected max file descriptor number: 2048 Aug 09 12:07:53.667754 dv-cinder-852369-1-smb devstack@keystone.service[80074]: lock engine: pthread robust mutexes Aug 09 12:07:53.667754 dv-cinder-852369-1-smb devstack@keystone.service[80074]: thunder lock: enabled Aug 09 12:07:53.667754 dv-cinder-852369-1-smb devstack@keystone.service[80074]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 09 12:07:53.667754 dv-cinder-852369-1-smb devstack@keystone.service[80074]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 12:07:53.707808 dv-cinder-852369-1-smb devstack@keystone.service[80074]: Python main interpreter initialized at 0x5603005459c0 Aug 09 12:07:53.707808 dv-cinder-852369-1-smb devstack@keystone.service[80074]: python threads support enabled Aug 09 12:07:53.707808 dv-cinder-852369-1-smb devstack@keystone.service[80074]: your server socket listen backlog is limited to 100 connections Aug 09 12:07:53.707808 dv-cinder-852369-1-smb devstack@keystone.service[80074]: your mercy for graceful operations on workers is 90 seconds Aug 09 12:07:53.708117 dv-cinder-852369-1-smb devstack@keystone.service[80074]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 12:07:53.708192 dv-cinder-852369-1-smb devstack@keystone.service[80074]: *** Operational MODE: preforking *** Aug 09 12:07:53.708419 dv-cinder-852369-1-smb devstack@keystone.service[80074]: *** uWSGI is running in multiple interpreter mode *** Aug 09 12:07:53.708419 dv-cinder-852369-1-smb devstack@keystone.service[80074]: spawned uWSGI master process (pid: 80074) Aug 09 12:07:53.708609 dv-cinder-852369-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 09 12:07:53.709826 dv-cinder-852369-1-smb devstack@keystone.service[80074]: spawned uWSGI worker 1 (pid: 80085, cores: 1) Aug 09 12:07:53.709826 dv-cinder-852369-1-smb devstack@keystone.service[80074]: spawned uWSGI worker 2 (pid: 80086, cores: 1) Aug 09 12:07:53.709826 dv-cinder-852369-1-smb devstack@keystone.service[80074]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 12:07:59.217860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:07:59.217860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: from cryptography.utils import int_from_bytes Aug 09 12:07:59.218861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:07:59.218861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: from cryptography.utils import int_from_bytes Aug 09 12:07:59.219610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:07:59.219610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: from cryptography.utils import int_from_bytes Aug 09 12:07:59.219809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:07:59.219809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: from cryptography.utils import int_from_bytes Aug 09 12:07:59.267970 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 12:07:59.268154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 12:07:59.268345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] command line args: [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 12:07:59.268440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 12:07:59.268612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 12:07:59.268737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 12:07:59.268808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ================================================================================ {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 12:07:59.268892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] command line args: [] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 12:07:59.269093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 12:07:59.269177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] admin_token = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.269295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ================================================================================ {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 12:07:59.269406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] config_dir = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.269597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] admin_token = **** {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.269686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.269826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] config_source = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.269902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] config_dir = [] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.270038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] debug = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.270122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.270259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.270561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] config_source = [] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.270561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] debug = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.270750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.270850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.270987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.271098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.271198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.271291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.271472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.271589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.271754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.271864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.271960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] log_config_append = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.272059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] list_limit = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.272165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.272271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] log_config_append = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.272367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] log_dir = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.272467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.272585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] log_file = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.272691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] log_dir = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.272839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] log_file = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.272923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.273130 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.273207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.273438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.273518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.273731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.273819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.273911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.274026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.274106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.274231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.274357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.274443 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.274636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.274719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.274915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.274991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.275192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.275272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.275479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.275557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.275766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.275843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.276054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.276132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.276356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.276433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.276672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.276759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.277057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.277325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.277528 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] publish_errors = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.277625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.277820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.277904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] publish_errors = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.278106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.278181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.278314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.278391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.278589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.278668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.278894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.278980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.279183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.279260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] standard_threads = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.279472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.279547 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] standard_threads = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.279757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.279838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.279972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.280053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.280178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] use_journal = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.280256 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.280384 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] use_json = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.280468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] use_journal = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.280588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] use_stderr = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.280691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] use_json = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.280845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] use_syslog = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.280988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] use_stderr = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.281136 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.281267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] use_syslog = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.281484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.281574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:07:59.281746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.281873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.282103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.282192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.282420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.282507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.282764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.282848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.283081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.283160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.283446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.283523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.283811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.283893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.284225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.284309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.284474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.284590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.284749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.284866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.284988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.285114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.285236 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.285350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.285473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.285599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.285721 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.285836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.285968 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.286083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.286206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.286336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.286489 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.286563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.286703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.286820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.286948 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.287075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.287186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.287322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.287440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.287558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.287703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.287811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.287955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.288072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.288202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.288326 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.288434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.288574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.288682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.288838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.288922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.289070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.289148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.289299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.289378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.289533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.289609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.289780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.289856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.290028 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.290107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.290258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.290335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.290486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.290569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.290731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.290809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.290976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.291051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.291210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.291287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.291448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.291526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.291677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.291753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.291903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.291979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.292121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.292193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.292348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.292431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.292574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.292671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.292830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.292910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.293059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.293138 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.293292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.293369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.293527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.293612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.293754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.293842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.293984 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.294061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.294212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.294295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.294447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.294530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.294674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.294749 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.294912 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.294996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.295138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.295220 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.295369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.295490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.295603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.295679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.296087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.296156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.296327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.296402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.296572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.296702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.296837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.296942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.297062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.297178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.297323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.297408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.297539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.297644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.297724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.297879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.297983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.298109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.298219 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.298345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.298449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.298580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.298684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.298846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.298976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.299081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.299160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.299327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.299404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.299571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.299650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.299806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.299883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.300038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.300122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.300271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.300351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.300515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.300593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.300777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.300858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.301012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.301090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.301247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.301325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.301477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.301554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.301710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.301789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.301941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.302019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.302172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.302249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.302402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.302480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.302630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.302706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.302894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.302970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.303133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.303212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.303369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.303448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.303607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.303685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.303829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.303903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.304061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.304140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.304295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.304372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.304523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.304611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.304778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.304865 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.305008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.305086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.305233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.305309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.305459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.305545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.305685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.305762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.305919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.305996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.306156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.306234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.306388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.306465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.306625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.306702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.306881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.306961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.307119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.307195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.307349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.external = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.307438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.307579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.307663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] auth.external = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.307806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.307884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.308089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.308176 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.308317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.password = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.308404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.308542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] auth.password = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.308662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] auth.token = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.308793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] auth.token = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.308875 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.309026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.309112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.309258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.309336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.309486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.309563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.309719 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.309805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.309966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.310045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.310194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.310278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.310430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.310516 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.310663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] credential.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.310741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.310911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.310994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.311155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.311241 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.311386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.311463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.311622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.311700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.311854 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.312768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.313256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.313599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.313681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.313753 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.313823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.313904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.313978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.313978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314547 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.314912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.315064 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.315143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.315314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.315394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] federation.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.315559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.315639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.315790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.315869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.316036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.316115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.316274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.316352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.316523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.316604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.316783 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.316863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.317035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.317115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.317268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.317352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.317511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.317595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.317744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.317824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.317988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.318066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.318221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.318299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.318442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.318517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.318675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.318754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.318921 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.319007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.319146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.319224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.319383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.319461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.319609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.319695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.319844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.319925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.320080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.320157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.320311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.320398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.320542 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.320639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.320794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.320872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.321026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.321117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.321271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.321351 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.321519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.321599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.321764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.321853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.322015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.322093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.322255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.322332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.322491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.322577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.322720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.322799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.322953 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.323032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.323181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.323271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.323414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.323500 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.323646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.323726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.323880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.323968 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.324119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.324199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.324345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.324423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.324590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.324729 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.324844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.324929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.325083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.325161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.325325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.325411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.325561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.325640 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.325787 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.325866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.326023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.326111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.326252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.326331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.326483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.326560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.326710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.326797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.326949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.327028 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.327189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.327268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.327423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.327508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.328218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.328311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.328477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.328611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.328761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.328902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.329033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.329161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.329288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.329431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.329559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.329695 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.329823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.329951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.330080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.330207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.330335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.330470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.330604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.330732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.330859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.330987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.331123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.331197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.331372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.331496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.331619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.331741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.331872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.331996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.332119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.332242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.332365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.332487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.332618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.332761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.332888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.333018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.333145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.333273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.333408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.333536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.333663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.333789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.333915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.334042 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.334177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.334304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.334431 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.334558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.334695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.334820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.334955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.335083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.335215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.335342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.335469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.335595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.335731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.335891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.336015 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.336143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.336270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.336398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.336541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.336712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.336837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.336963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.337088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.337214 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.337350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.337477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.337602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.337727 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.337853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.337978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.338112 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.338249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.338376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.338517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.338644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.338770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.338903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.339064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.339184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.339319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.339445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.339573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.339708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.339835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.339960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.340095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.340221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.340346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.340479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.340606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.340751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.340879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] resource.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.341007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.341135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.341272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.341401 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.341529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.341657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.341784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.341921 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.342057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.342186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.342313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.342441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.342568 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.342697 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.342898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] role.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.343025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.343149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] role.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.343272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.343395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.343519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] role.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.343652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.343906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] role.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.344039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.344166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.344291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.344415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.344549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.344726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.344853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.344982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.345110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.345253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.345376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.345503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.345642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.345642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.345885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.346019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.346146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.346271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.346398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.346524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.346650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.346790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.346918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.346918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.347157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.347295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.347423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.347557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.347686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.347686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.347928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.347928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.348167 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.348301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.348428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.348553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.348697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.348697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.348949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.349087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.349216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.349340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.349462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.349585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.349707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.349839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.349964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.350092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.350221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.350344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.350474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.350612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.350742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.350871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.350995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.351118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.351248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.351376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.351498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.351625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.351748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.351871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] token.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.352007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.352136 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.352264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.352399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.352528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.352674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.352808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] token.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.352938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.353062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.353187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.353311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.353435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.353566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.353690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.353814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.353938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.354061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.354195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.354326 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.354450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.354575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.354698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.354821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.354946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.355076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.355205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.355328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.355451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.355574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.355698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.355837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.355963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.356086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.356210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.356335 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.356458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.connection = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.356594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.356780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.356916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.357044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.357171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.357298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.357425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.connection = **** {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.357564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.357706 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.357842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.357969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.358097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.358223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.358350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.358477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.358612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.358738 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.358902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.359149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.359344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.359428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.359498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.359633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.359756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.359884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.360010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.360135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.360268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.360395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.360521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.360665 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.360790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.360919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.361057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.361184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.361309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.361309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 12:07:59.361561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.361561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.361561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.361561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:07:59.361561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 12:07:59.387120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.387304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.387450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.387583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.387716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.387862 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.398057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.398295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.426764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.427002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.427090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.427250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.480824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.481216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.533178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.533411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.533502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.533686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.599072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.599299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.599388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.599523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.599627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.599742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.599826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.599957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.600040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.600171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.600262 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.600391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.623708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.623940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.624026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.624166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.624249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.624390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.624503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.625462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.625607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.625607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.625764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.625836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.625908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.625979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.636842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.637130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.649649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.649882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.650133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.650231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.650356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.650438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.650574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.650655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.650790 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.650873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.651004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.651085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.651260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.651473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:07:59.668206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.668421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 12:07:59.668504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.668743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 12:07:59.668826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.668988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 12:07:59.669097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.669265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.669344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 12:07:59.669532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.669619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.669796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.669876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.670054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.670132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.670315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.682558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.682736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.682844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.683017 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.683098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.683293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.683375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.683579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.691158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.691474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.694242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.694530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.694610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.694816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.694898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.695103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.695193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.695411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.695571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.695648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.695717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.695923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.696044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.696192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.696298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.696466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.696559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.696763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.696856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.697038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.697129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.697308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.720084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.720442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.721597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.721885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.721975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.722237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.726491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.726780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.726870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.727067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.727159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.727426 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.733777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.734586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.734680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.734878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.738890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.738987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.739185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.739297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.739473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.739577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.739769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.739860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.740052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.740143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.740352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.740453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.740656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.740748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.740938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.741074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.757647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.757789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.757917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.758044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.761947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.762091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.765155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.765286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.765554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.766608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.770228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.771040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.773446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.774247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.776587 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.776916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.777220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.777440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.777570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.777745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.777875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.778037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.778168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.778324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.778604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.778897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.794315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.794615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.794887 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.795118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.795247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.795452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.795693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.796215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.802895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.803729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.804469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.804771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.805310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.805595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.807567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.807855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.808166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.808401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.808530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.808718 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.808862 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.809029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.809324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.809607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.820764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.821052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.821337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.821611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.821748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.821883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.822026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.822167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.822299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.822439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.822569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.822701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.822986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.823268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.839007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.840033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.841972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.843024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.845488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.846941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.847073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.848513 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.848662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.848835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.849123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.850043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.850331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.850625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.855755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.857097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.857408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.859859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.860937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.861234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.861530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.861813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.862817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.863115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.863411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.863699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.870392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.870735 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.871030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.872360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.872692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.872985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.877977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.878264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.878548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.878825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.879100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.879385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.879661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.879941 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.880069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:07:59.880255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.880386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.880544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.880701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.880860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.881009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.881137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.881262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.881398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.881577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.881713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.881841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.881967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.882315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.882596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.882874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.883160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.883434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.883701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:07:59.915692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603005459c0 pid: 80086 (default app) Aug 09 12:07:59.917487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603005459c0 pid: 80085 (default app) Aug 09 12:07:59.918990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9d067-a154-46ca-b3b1-add49ff63075 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:07:59.919275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9d067-a154-46ca-b3b1-add49ff63075 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:07:59.919545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9d067-a154-46ca-b3b1-add49ff63075 None None] PATH_INFO: `/v3` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:07:59.924668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue Aug 9 12:07:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:07.507729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21db95-78c4-4e3b-9a61-6c93b4d0f289 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:07.508268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21db95-78c4-4e3b-9a61-6c93b4d0f289 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:07.508268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21db95-78c4-4e3b-9a61-6c93b4d0f289 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:07.512662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:07.518442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:07.518837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:07.518989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:07.589252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: INFO dbcounter [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] Registered counter for database keystone Aug 09 12:08:07.608052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG oslo_db.sqlalchemy.engines [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:08:07.614354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writer thread running {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:08:07.791378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG passlib.handlers.bcrypt [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80086) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 12:08:07.791712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG passlib.handlers.bcrypt [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80086) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 12:08:07.846339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:07.847931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:07.976890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 12:08:08.132094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21db95-78c4-4e3b-9a61-6c93b4d0f289 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:08.201359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: INFO dbcounter [None req-7b21db95-78c4-4e3b-9a61-6c93b4d0f289 None None] Registered counter for database keystone Aug 09 12:08:08.223016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG oslo_db.sqlalchemy.engines [None req-7b21db95-78c4-4e3b-9a61-6c93b4d0f289 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:08:08.229278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writer thread running {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:08:08.346985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21db95-78c4-4e3b-9a61-6c93b4d0f289 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:08.351261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6b9f0-00aa-4dfb-a376-f89b91148d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:08.351882 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b9f0-00aa-4dfb-a376-f89b91148d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:08.352163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b9f0-00aa-4dfb-a376-f89b91148d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:08.352437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b9f0-00aa-4dfb-a376-f89b91148d3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:08.361191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6b9f0-00aa-4dfb-a376-f89b91148d3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:08.413162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2ae6b9f0-00aa-4dfb-a376-f89b91148d3b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 12:08:08.413442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6b9f0-00aa-4dfb-a376-f89b91148d3b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:08.424351 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Aug 9 12:08:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:08:08.430247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:08.444646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f00470-da80-4b22-b7aa-7d801f8b7623 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:08.449097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3ee5d-2fd1-47eb-81fc-82acf8d34df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:08.450195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3ee5d-2fd1-47eb-81fc-82acf8d34df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:08.450476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3ee5d-2fd1-47eb-81fc-82acf8d34df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:08.450749 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3ee5d-2fd1-47eb-81fc-82acf8d34df6 admin admin] PATH_INFO: `/v3/projects/95743c69ba944a32817628bc182e9a85` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:08.452192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3ee5d-2fd1-47eb-81fc-82acf8d34df6 admin admin] RBAC: Authorizing `identity:get_project(project_id=95743c69ba944a32817628bc182e9a85)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:08.502718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WARNING keystone.common.rbac_enforcer.enforcer [None req-66d3ee5d-2fd1-47eb-81fc-82acf8d34df6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 12:08:08.503058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3ee5d-2fd1-47eb-81fc-82acf8d34df6 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:08.507628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Aug 9 12:08:08 2022] GET /identity/v3/projects/95743c69ba944a32817628bc182e9a85 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:10.472703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71c8c-a642-494c-8e25-aa1a4e783b5a None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:10.473187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71c8c-a642-494c-8e25-aa1a4e783b5a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:10.473287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71c8c-a642-494c-8e25-aa1a4e783b5a None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:10.477325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:10.482660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c13e4-ee70-4304-b261-0165843800ec None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:10.483039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c13e4-ee70-4304-b261-0165843800ec None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:10.483199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c13e4-ee70-4304-b261-0165843800ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:10.505018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-402c13e4-ee70-4304-b261-0165843800ec None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:10.506565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-402c13e4-ee70-4304-b261-0165843800ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:10.514280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 12:08:10.536470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a71c8c-a642-494c-8e25-aa1a4e783b5a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:10.549773 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a71c8c-a642-494c-8e25-aa1a4e783b5a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:10.552950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a1d88-37a9-4167-965b-1572badd0e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:10.553540 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a1d88-37a9-4167-965b-1572badd0e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:10.553818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a1d88-37a9-4167-965b-1572badd0e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:10.554086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a1d88-37a9-4167-965b-1572badd0e82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:10.561690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a1d88-37a9-4167-965b-1572badd0e82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:10.564101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a1d88-37a9-4167-965b-1572badd0e82 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:10.572794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Aug 9 12:08:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:08:10.578772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c13e4-ee70-4304-b261-0165843800ec None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:10.587698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c13e4-ee70-4304-b261-0165843800ec None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:10.592023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e77631-51ff-4896-9377-687128fb57f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:10.592658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77631-51ff-4896-9377-687128fb57f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:10.592936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77631-51ff-4896-9377-687128fb57f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:10.593204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77631-51ff-4896-9377-687128fb57f7 admin admin] PATH_INFO: `/v3/users/3854e1394dc743bfbab4ce7b02389426` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:10.594634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e77631-51ff-4896-9377-687128fb57f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=3854e1394dc743bfbab4ce7b02389426)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:10.596419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e77631-51ff-4896-9377-687128fb57f7 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:10.597959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue Aug 9 12:08:10 2022] GET /identity/v3/users/3854e1394dc743bfbab4ce7b02389426 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:12.642720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec402-3066-4280-8ef4-fcde7bfb1685 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:12.643278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec402-3066-4280-8ef4-fcde7bfb1685 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:12.643278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec402-3066-4280-8ef4-fcde7bfb1685 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:12.644583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:12.649604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134969e-8431-45be-96db-f25e55aae89e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:12.649985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134969e-8431-45be-96db-f25e55aae89e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:12.650293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134969e-8431-45be-96db-f25e55aae89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:12.667840 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4134969e-8431-45be-96db-f25e55aae89e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:12.669085 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4134969e-8431-45be-96db-f25e55aae89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:12.684889 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0d6b-6ed3-414b-baca-b6529a5596a0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:12.685172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0d6b-6ed3-414b-baca-b6529a5596a0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:12.685442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0d6b-6ed3-414b-baca-b6529a5596a0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:12.686758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:12.692165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438755-7d1c-4256-bf0b-0033ae67b225 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:12.692445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438755-7d1c-4256-bf0b-0033ae67b225 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:12.692751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438755-7d1c-4256-bf0b-0033ae67b225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:12.736139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG passlib.handlers.bcrypt [None req-bc438755-7d1c-4256-bf0b-0033ae67b225 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80085) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 12:08:12.736698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG passlib.handlers.bcrypt [None req-bc438755-7d1c-4256-bf0b-0033ae67b225 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80085) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 12:08:12.749237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:12.772474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134969e-8431-45be-96db-f25e55aae89e None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:12.783389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bc438755-7d1c-4256-bf0b-0033ae67b225 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:12.785024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bc438755-7d1c-4256-bf0b-0033ae67b225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:12.795151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:12.876714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134969e-8431-45be-96db-f25e55aae89e None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:12.883532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:12.905835 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc438755-7d1c-4256-bf0b-0033ae67b225 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:12.910850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a59c67-a956-4045-b3a1-c2b3ddf09850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:12.911490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a59c67-a956-4045-b3a1-c2b3ddf09850 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:12.911769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a59c67-a956-4045-b3a1-c2b3ddf09850 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:12.912044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a59c67-a956-4045-b3a1-c2b3ddf09850 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:12.923652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a59c67-a956-4045-b3a1-c2b3ddf09850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-d0a59c67-a956-4045-b3a1-c2b3ddf09850 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:12.932343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:12.933447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:12.934525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:12.939862 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a59c67-a956-4045-b3a1-c2b3ddf09850 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:13.007742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc438755-7d1c-4256-bf0b-0033ae67b225 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:13.010024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:13.019766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:13.038475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a59c67-a956-4045-b3a1-c2b3ddf09850 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:13.044655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb9ac9-6fb0-419b-8fac-ec538d4390d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:13.045519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9ac9-6fb0-419b-8fac-ec538d4390d8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:13.045800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9ac9-6fb0-419b-8fac-ec538d4390d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:13.046074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9ac9-6fb0-419b-8fac-ec538d4390d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:13.073492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72054cd7-cdbe-4b08-b1a1-3e3eadd1e873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:13.074098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72054cd7-cdbe-4b08-b1a1-3e3eadd1e873 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:13.074377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72054cd7-cdbe-4b08-b1a1-3e3eadd1e873 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:13.074845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72054cd7-cdbe-4b08-b1a1-3e3eadd1e873 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:13.075719 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72054cd7-cdbe-4b08-b1a1-3e3eadd1e873 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:13.076093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72054cd7-cdbe-4b08-b1a1-3e3eadd1e873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:13.078127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72054cd7-cdbe-4b08-b1a1-3e3eadd1e873 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:13.089794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:13.095366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72054cd7-cdbe-4b08-b1a1-3e3eadd1e873 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:13.114924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb9ac9-6fb0-419b-8fac-ec538d4390d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:13.116456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb9ac9-6fb0-419b-8fac-ec538d4390d8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:13.218331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:08:13.224535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb9ac9-6fb0-419b-8fac-ec538d4390d8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:13.227763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:13.304987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72054cd7-cdbe-4b08-b1a1-3e3eadd1e873 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:13.327814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb9ac9-6fb0-419b-8fac-ec538d4390d8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:13.338633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a33d2d-fbd6-4946-af13-c1d563697c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:13.339257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33d2d-fbd6-4946-af13-c1d563697c7c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:13.339532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33d2d-fbd6-4946-af13-c1d563697c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:13.339856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33d2d-fbd6-4946-af13-c1d563697c7c None admin] PATH_INFO: `/v3/users/3854e1394dc743bfbab4ce7b02389426` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:13.341000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a33d2d-fbd6-4946-af13-c1d563697c7c None admin] RBAC: Authorizing `identity:get_user(user_id=3854e1394dc743bfbab4ce7b02389426)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:13.342447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a33d2d-fbd6-4946-af13-c1d563697c7c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:13.344918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:13 2022] GET /identity/v3/users/3854e1394dc743bfbab4ce7b02389426 => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:13.350251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a33d2d-fbd6-4946-af13-c1d563697c7c None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:13.362285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab58994-1094-4564-9518-ccce12145944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:13.363135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab58994-1094-4564-9518-ccce12145944 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:13.363411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab58994-1094-4564-9518-ccce12145944 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:13.363683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab58994-1094-4564-9518-ccce12145944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:13.365475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:13.382454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab58994-1094-4564-9518-ccce12145944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:13.383926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab58994-1094-4564-9518-ccce12145944 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-aab58994-1094-4564-9518-ccce12145944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:08:13.401777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:13.402815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:08:13.403758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:08:13.403758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:08:13.403758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:13.403758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:13.409328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab58994-1094-4564-9518-ccce12145944 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:13.457958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a33d2d-fbd6-4946-af13-c1d563697c7c None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:13.469655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:13.493550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dde36-bec5-4f28-9d17-d6a55930a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:13.494179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dde36-bec5-4f28-9d17-d6a55930a5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:13.494458 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dde36-bec5-4f28-9d17-d6a55930a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:13.494724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dde36-bec5-4f28-9d17-d6a55930a5c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:13.495833 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dde36-bec5-4f28-9d17-d6a55930a5c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:13.497303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dde36-bec5-4f28-9d17-d6a55930a5c4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:13.498857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:13.504881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dde36-bec5-4f28-9d17-d6a55930a5c4 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:13.515107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab58994-1094-4564-9518-ccce12145944 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:13.556686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e93f4-f9a5-4390-954e-86510671eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:13.557319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e93f4-f9a5-4390-954e-86510671eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:13.557599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e93f4-f9a5-4390-954e-86510671eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:13.557865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e93f4-f9a5-4390-954e-86510671eaa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:13.558501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e93f4-f9a5-4390-954e-86510671eaa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:13.558795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e93f4-f9a5-4390-954e-86510671eaa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:13.560770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e93f4-f9a5-4390-954e-86510671eaa2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:13.577994 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:13.601543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:13.625404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dde36-bec5-4f28-9d17-d6a55930a5c4 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:13.661674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a297a6-ddc3-40f8-82ea-3525eb2892f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:13.662365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a297a6-ddc3-40f8-82ea-3525eb2892f2 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:13.662557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a297a6-ddc3-40f8-82ea-3525eb2892f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:13.662824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a297a6-ddc3-40f8-82ea-3525eb2892f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:13.663558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a297a6-ddc3-40f8-82ea-3525eb2892f2 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.domain.id=default, user.id=3854e1394dc743bfbab4ce7b02389426) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:13.663853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a297a6-ddc3-40f8-82ea-3525eb2892f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:13.665339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a297a6-ddc3-40f8-82ea-3525eb2892f2 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:13.674033 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Aug 9 12:08:13 2022] GET /identity/v3/role_assignments?user.id=3854e1394dc743bfbab4ce7b02389426&scope.domain.id=default&role.id=d6155b01aace49f887f29aa2861d31cf => generated 233 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:15.985948 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79271ef-6335-418d-bcb9-ec1bb970f898 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:15.986858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79271ef-6335-418d-bcb9-ec1bb970f898 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:15.987297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79271ef-6335-418d-bcb9-ec1bb970f898 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:15.989109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:15.993967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3d80c-a0af-4115-b3de-a0e9c1abd8da None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:15.994722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3d80c-a0af-4115-b3de-a0e9c1abd8da None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:15.995163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3d80c-a0af-4115-b3de-a0e9c1abd8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:16.021638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-dda3d80c-a0af-4115-b3de-a0e9c1abd8da None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:16.023121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-dda3d80c-a0af-4115-b3de-a0e9c1abd8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:16.108155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:16.143823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79271ef-6335-418d-bcb9-ec1bb970f898 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:16.266872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79271ef-6335-418d-bcb9-ec1bb970f898 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:16.280201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937efad-8cfb-4ce3-955d-749f53a414d5 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:16.280756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937efad-8cfb-4ce3-955d-749f53a414d5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:16.281598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937efad-8cfb-4ce3-955d-749f53a414d5 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:16.283125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:16.288456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559d677-9321-4523-bde9-85f7b66b0573 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:16.288984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559d677-9321-4523-bde9-85f7b66b0573 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:16.289419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559d677-9321-4523-bde9-85f7b66b0573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:16.305603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:16.316655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c559d677-9321-4523-bde9-85f7b66b0573 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:16.316655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c559d677-9321-4523-bde9-85f7b66b0573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:16.341250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c9650-fc0d-42a8-a472-8f075b4b6661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:16.341899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c9650-fc0d-42a8-a472-8f075b4b6661 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:16.342179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c9650-fc0d-42a8-a472-8f075b4b6661 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:16.342448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c9650-fc0d-42a8-a472-8f075b4b6661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:16.360638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c9650-fc0d-42a8-a472-8f075b4b6661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:16.362811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c9650-fc0d-42a8-a472-8f075b4b6661 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-232c9650-fc0d-42a8-a472-8f075b4b6661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:08:16.395729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:16.396663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:08:16.397468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:08:16.397468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:08:16.397468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:16.398582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 12/25] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:16.402723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125440c-309f-42a1-9f36-eb00f7ef3deb None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:16.403008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125440c-309f-42a1-9f36-eb00f7ef3deb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:16.403281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125440c-309f-42a1-9f36-eb00f7ef3deb None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:16.404566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 13/26] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:16.405296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125440c-309f-42a1-9f36-eb00f7ef3deb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:16.475962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:16.477307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ba037-cbd4-447d-928d-2cd0aef707a4 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:16.477599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ba037-cbd4-447d-928d-2cd0aef707a4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:16.477877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ba037-cbd4-447d-928d-2cd0aef707a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:16.500387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:16.524350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9d8ba037-cbd4-447d-928d-2cd0aef707a4 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:16.525493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9d8ba037-cbd4-447d-928d-2cd0aef707a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:16.593236 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125440c-309f-42a1-9f36-eb00f7ef3deb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:16.629404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 15/28] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:16.630693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ba037-cbd4-447d-928d-2cd0aef707a4 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:16.751382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ae0e-ffab-4911-83b1-9d382749a407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:16.752000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ae0e-ffab-4911-83b1-9d382749a407 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:16.752275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ae0e-ffab-4911-83b1-9d382749a407 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:16.752517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ae0e-ffab-4911-83b1-9d382749a407 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:16.753244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ae0e-ffab-4911-83b1-9d382749a407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:16.753547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ae0e-ffab-4911-83b1-9d382749a407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:16.755119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ae0e-ffab-4911-83b1-9d382749a407 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:16.758519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ba037-cbd4-447d-928d-2cd0aef707a4 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:16.767837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 14/29] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:16.773242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f846d-58df-4cf6-a37d-122049d66447 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:16.773533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f846d-58df-4cf6-a37d-122049d66447 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:16.773807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f846d-58df-4cf6-a37d-122049d66447 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:16.779134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:16.779134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f846d-58df-4cf6-a37d-122049d66447 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:16.805380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcf5b1-bf5b-4a2e-a35b-ea554de28444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:16.806352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcf5b1-bf5b-4a2e-a35b-ea554de28444 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:16.807089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcf5b1-bf5b-4a2e-a35b-ea554de28444 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:16.807751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcf5b1-bf5b-4a2e-a35b-ea554de28444 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:16.808544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcf5b1-bf5b-4a2e-a35b-ea554de28444 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:16.809955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:16.810389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcf5b1-bf5b-4a2e-a35b-ea554de28444 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:16.815823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:16.901142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f846d-58df-4cf6-a37d-122049d66447 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:16.938924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b308e72-e758-4563-83ac-6dbcca4699d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:16.939822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b308e72-e758-4563-83ac-6dbcca4699d7 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:16.940328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b308e72-e758-4563-83ac-6dbcca4699d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:16.940834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b308e72-e758-4563-83ac-6dbcca4699d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:16.941701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b308e72-e758-4563-83ac-6dbcca4699d7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:16.943306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b308e72-e758-4563-83ac-6dbcca4699d7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:16.954431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 16/31] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Aug 9 12:08:16 2022] POST /identity/v3/roles => generated 225 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:16.955751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcf5b1-bf5b-4a2e-a35b-ea554de28444 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:17.074863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 16/32] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Aug 9 12:08:16 2022] POST /identity/v3/roles => generated 219 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:17.077261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2c0df-57a8-48ad-81d4-804c379496be None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.077824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2c0df-57a8-48ad-81d4-804c379496be None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.078328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2c0df-57a8-48ad-81d4-804c379496be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.099823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d7c2c0df-57a8-48ad-81d4-804c379496be None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:17.101861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d7c2c0df-57a8-48ad-81d4-804c379496be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:17.182849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 17/33] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:17.192856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcf5b1-bf5b-4a2e-a35b-ea554de28444 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:17.227790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2c0df-57a8-48ad-81d4-804c379496be None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:17.260328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd3e18-1eec-4606-8bad-8b7f5c6d0910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:17.262366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd3e18-1eec-4606-8bad-8b7f5c6d0910 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.263075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:17.264855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd3e18-1eec-4606-8bad-8b7f5c6d0910 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.265471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd3e18-1eec-4606-8bad-8b7f5c6d0910 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.266339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd3e18-1eec-4606-8bad-8b7f5c6d0910 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:17.271884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd3e18-1eec-4606-8bad-8b7f5c6d0910 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:17.330720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 17/34] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:08:16 2022] POST /identity/v3/projects => generated 301 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:17.368314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2c0df-57a8-48ad-81d4-804c379496be None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:17.407483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d7000-b12a-4963-8c23-edf29ac30167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:17.408437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7000-b12a-4963-8c23-edf29ac30167 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.408917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7000-b12a-4963-8c23-edf29ac30167 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.409382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7000-b12a-4963-8c23-edf29ac30167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.425010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d7000-b12a-4963-8c23-edf29ac30167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-767d7000-b12a-4963-8c23-edf29ac30167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:17.431846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:17.432782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:17.433504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:17.435521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 18/35] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:17.441642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd3e18-1eec-4606-8bad-8b7f5c6d0910 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:17.497425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:17.526801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d0d69-e3e6-47c9-bb2f-09d3a5606702 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.527112 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d0d69-e3e6-47c9-bb2f-09d3a5606702 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.527348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d0d69-e3e6-47c9-bb2f-09d3a5606702 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.528950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:17.535488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdb91b-9362-49ee-b8ab-95d94bd4383a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.535784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdb91b-9362-49ee-b8ab-95d94bd4383a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.536038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdb91b-9362-49ee-b8ab-95d94bd4383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.555633 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-99cdb91b-9362-49ee-b8ab-95d94bd4383a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:17.557016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-99cdb91b-9362-49ee-b8ab-95d94bd4383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:17.567725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd3e18-1eec-4606-8bad-8b7f5c6d0910 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:17.612992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d51fcc-d055-4aff-9453-a7679ee91e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:17.613642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d51fcc-d055-4aff-9453-a7679ee91e9b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.613993 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d51fcc-d055-4aff-9453-a7679ee91e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.614352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d51fcc-d055-4aff-9453-a7679ee91e9b None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.615147 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d51fcc-d055-4aff-9453-a7679ee91e9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:17.615451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d51fcc-d055-4aff-9453-a7679ee91e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:17.617877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d51fcc-d055-4aff-9453-a7679ee91e9b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:17.627959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 18/37] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:17.628575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c0f91-0a54-485f-aeb3-ea30c7337852 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.628929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c0f91-0a54-485f-aeb3-ea30c7337852 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.631560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c0f91-0a54-485f-aeb3-ea30c7337852 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.631560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 19/38] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:17.634581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c0f91-0a54-485f-aeb3-ea30c7337852 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:17.640856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 20/39] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:17.642153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f446cda-2f03-483c-bfe0-a0c1974c5237 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.642441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f446cda-2f03-483c-bfe0-a0c1974c5237 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.642715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f446cda-2f03-483c-bfe0-a0c1974c5237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.662740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5f446cda-2f03-483c-bfe0-a0c1974c5237 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:17.663935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5f446cda-2f03-483c-bfe0-a0c1974c5237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:17.666183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:17.730660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 21/40] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:17.731475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f446cda-2f03-483c-bfe0-a0c1974c5237 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:17.742509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c0f91-0a54-485f-aeb3-ea30c7337852 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:17.752361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:17.778207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192321-8037-4e5b-ad81-aa2cc7e638ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:17.778839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192321-8037-4e5b-ad81-aa2cc7e638ba None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.779115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192321-8037-4e5b-ad81-aa2cc7e638ba None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.779394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192321-8037-4e5b-ad81-aa2cc7e638ba None admin] PATH_INFO: `/v3/users/3854e1394dc743bfbab4ce7b02389426` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.780507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20192321-8037-4e5b-ad81-aa2cc7e638ba None admin] RBAC: Authorizing `identity:get_user(user_id=3854e1394dc743bfbab4ce7b02389426)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:17.782679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20192321-8037-4e5b-ad81-aa2cc7e638ba None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:17.784244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 20/41] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:17 2022] GET /identity/v3/users/3854e1394dc743bfbab4ce7b02389426 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:17.785015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192321-8037-4e5b-ad81-aa2cc7e638ba None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:17.837233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f446cda-2f03-483c-bfe0-a0c1974c5237 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:17.870558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2827d20-3ed8-4210-892e-dcb360965f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:17.871097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827d20-3ed8-4210-892e-dcb360965f77 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.871374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827d20-3ed8-4210-892e-dcb360965f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.871645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827d20-3ed8-4210-892e-dcb360965f77 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.872298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2827d20-3ed8-4210-892e-dcb360965f77 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:17.873854 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2827d20-3ed8-4210-892e-dcb360965f77 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:17.884428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:17.887029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192321-8037-4e5b-ad81-aa2cc7e638ba None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:17.901582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Aug 9 12:08:17 2022] POST /identity/v3/roles => generated 223 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:17.901582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2827d20-3ed8-4210-892e-dcb360965f77 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:17.927068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a4a86-a132-4b7f-a1aa-5f30b6e4c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:17.927728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a4a86-a132-4b7f-a1aa-5f30b6e4c826 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:17.927997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a4a86-a132-4b7f-a1aa-5f30b6e4c826 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:17.928277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a4a86-a132-4b7f-a1aa-5f30b6e4c826 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:17.929553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a4a86-a132-4b7f-a1aa-5f30b6e4c826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:17.931027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a4a86-a132-4b7f-a1aa-5f30b6e4c826 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:17.932869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:17.939156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a4a86-a132-4b7f-a1aa-5f30b6e4c826 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:18.000302 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:18.022529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2827d20-3ed8-4210-892e-dcb360965f77 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:18.065126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f27eb-32a3-4896-9b07-410a48189707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:18.066615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f27eb-32a3-4896-9b07-410a48189707 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:18.066898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f27eb-32a3-4896-9b07-410a48189707 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:18.067173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f27eb-32a3-4896-9b07-410a48189707 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:18.068112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a4a86-a132-4b7f-a1aa-5f30b6e4c826 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:18.068713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f27eb-32a3-4896-9b07-410a48189707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:18.070134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f27eb-32a3-4896-9b07-410a48189707 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:18.071785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 23/44] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:18.077467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f27eb-32a3-4896-9b07-410a48189707 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:18.107297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18127f2-11cd-45ac-af73-60e8d49533e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:18.107916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18127f2-11cd-45ac-af73-60e8d49533e2 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:18.108198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18127f2-11cd-45ac-af73-60e8d49533e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:18.108479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18127f2-11cd-45ac-af73-60e8d49533e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:18.109237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18127f2-11cd-45ac-af73-60e8d49533e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:18.110706 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18127f2-11cd-45ac-af73-60e8d49533e2 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:18.137579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:08:17 2022] POST /identity/v3/projects => generated 312 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:08:18.149421 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:18.190084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f27eb-32a3-4896-9b07-410a48189707 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:18.227041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3195a-f582-4648-86bf-b9b3be218c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:18.227717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3195a-f582-4648-86bf-b9b3be218c32 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:18.228001 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3195a-f582-4648-86bf-b9b3be218c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:18.228278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3195a-f582-4648-86bf-b9b3be218c32 None admin] PATH_INFO: `/v3/domains/default/users/3854e1394dc743bfbab4ce7b02389426/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:18.230543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3195a-f582-4648-86bf-b9b3be218c32 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3854e1394dc743bfbab4ce7b02389426, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:18.232023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3195a-f582-4648-86bf-b9b3be218c32 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:18.248205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 24/46] 10.222.0.25 () {58 vars in 1361 bytes} [Tue Aug 9 12:08:18 2022] PUT /identity/v3/domains/default/users/3854e1394dc743bfbab4ce7b02389426/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:08:20.186593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3446ee-00bd-411c-99e1-86407f4828b5 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:20.187625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3446ee-00bd-411c-99e1-86407f4828b5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:20.187792 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3446ee-00bd-411c-99e1-86407f4828b5 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:20.189069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 23/47] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:20.194321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586120d-a923-47b8-adef-32eb00864932 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:20.194720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586120d-a923-47b8-adef-32eb00864932 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:20.194865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586120d-a923-47b8-adef-32eb00864932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:20.213304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f586120d-a923-47b8-adef-32eb00864932 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:20.214516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f586120d-a923-47b8-adef-32eb00864932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:20.230493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073cab3-3e8f-4af2-931c-08c2bee4ca33 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:20.230773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073cab3-3e8f-4af2-931c-08c2bee4ca33 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:20.231050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073cab3-3e8f-4af2-931c-08c2bee4ca33 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:20.232380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 24/48] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:20.237238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740acee1-d17a-475d-a88a-b67eb651ed25 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:20.237517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740acee1-d17a-475d-a88a-b67eb651ed25 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:20.237793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740acee1-d17a-475d-a88a-b67eb651ed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:20.257742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-740acee1-d17a-475d-a88a-b67eb651ed25 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:20.259573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-740acee1-d17a-475d-a88a-b67eb651ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:20.281240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 25/49] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:20.303919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586120d-a923-47b8-adef-32eb00864932 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:20.326835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 25/50] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:20.349480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740acee1-d17a-475d-a88a-b67eb651ed25 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:20.359193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:20.376476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:20.405136 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586120d-a923-47b8-adef-32eb00864932 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:20.439716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa996ab7-5ab3-4e1f-9336-eef9dae2a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:20.440289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa996ab7-5ab3-4e1f-9336-eef9dae2a491 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:20.440574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa996ab7-5ab3-4e1f-9336-eef9dae2a491 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:20.440886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa996ab7-5ab3-4e1f-9336-eef9dae2a491 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:20.442005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa996ab7-5ab3-4e1f-9336-eef9dae2a491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:20.443437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa996ab7-5ab3-4e1f-9336-eef9dae2a491 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:20.445045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 26/51] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:20.450586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa996ab7-5ab3-4e1f-9336-eef9dae2a491 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:20.456528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740acee1-d17a-475d-a88a-b67eb651ed25 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:20.489627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0a0a8-3454-4022-89eb-5c25d8be81bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:20.490254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0a0a8-3454-4022-89eb-5c25d8be81bd None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:20.490531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0a0a8-3454-4022-89eb-5c25d8be81bd None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:20.490800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0a0a8-3454-4022-89eb-5c25d8be81bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:20.501192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0a0a8-3454-4022-89eb-5c25d8be81bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-4fb0a0a8-3454-4022-89eb-5c25d8be81bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:20.505874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:20.506699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:20.507450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 26/52] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:20.512713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0a0a8-3454-4022-89eb-5c25d8be81bd None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:20.548828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa996ab7-5ab3-4e1f-9336-eef9dae2a491 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:20.571812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:20.582717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d01e05-7b7d-44c1-8bfa-707764e95ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:20.583317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d01e05-7b7d-44c1-8bfa-707764e95ad3 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:20.583598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d01e05-7b7d-44c1-8bfa-707764e95ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:20.583872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d01e05-7b7d-44c1-8bfa-707764e95ad3 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:20.584517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d01e05-7b7d-44c1-8bfa-707764e95ad3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:20.586063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d01e05-7b7d-44c1-8bfa-707764e95ad3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:20.596143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:20.613459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 27/53] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Aug 9 12:08:20 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:08:20.613609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0a0a8-3454-4022-89eb-5c25d8be81bd None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:20.654821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5541-ea2d-46d1-86e6-2bebc4f3706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:20.655430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5541-ea2d-46d1-86e6-2bebc4f3706b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:20.655706 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5541-ea2d-46d1-86e6-2bebc4f3706b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:20.656081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5541-ea2d-46d1-86e6-2bebc4f3706b None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:20.657197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad5541-ea2d-46d1-86e6-2bebc4f3706b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:20.657508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad5541-ea2d-46d1-86e6-2bebc4f3706b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:20.659236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad5541-ea2d-46d1-86e6-2bebc4f3706b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:20.668751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 27/54] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:20.675413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d01e05-7b7d-44c1-8bfa-707764e95ad3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:20.778814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d01e05-7b7d-44c1-8bfa-707764e95ad3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:20.811965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a13fb-b87c-40d6-bc94-8b48b95fe0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:20.813190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a13fb-b87c-40d6-bc94-8b48b95fe0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:20.813472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a13fb-b87c-40d6-bc94-8b48b95fe0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:20.813740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a13fb-b87c-40d6-bc94-8b48b95fe0f9 None admin] PATH_INFO: `/v3/users/3854e1394dc743bfbab4ce7b02389426` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:20.814886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a13fb-b87c-40d6-bc94-8b48b95fe0f9 None admin] RBAC: Authorizing `identity:get_user(user_id=3854e1394dc743bfbab4ce7b02389426)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:20.816335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a13fb-b87c-40d6-bc94-8b48b95fe0f9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:20.817953 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:20 2022] GET /identity/v3/users/3854e1394dc743bfbab4ce7b02389426 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:20.823354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5541-ea2d-46d1-86e6-2bebc4f3706b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:20.920606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5541-ea2d-46d1-86e6-2bebc4f3706b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:20.953504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bec315-924a-466b-8d2e-2c92e68563b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:20.954125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bec315-924a-466b-8d2e-2c92e68563b9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:20.954403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bec315-924a-466b-8d2e-2c92e68563b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:20.954674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bec315-924a-466b-8d2e-2c92e68563b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:20.955775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bec315-924a-466b-8d2e-2c92e68563b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:20.957266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bec315-924a-466b-8d2e-2c92e68563b9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:20.958878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 28/56] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:20.964570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a13fb-b87c-40d6-bc94-8b48b95fe0f9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:21.010143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:21.065393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a13fb-b87c-40d6-bc94-8b48b95fe0f9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:21.098575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02695446-d872-4261-a11d-4bc2ea572992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:21.099182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695446-d872-4261-a11d-4bc2ea572992 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:21.099466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695446-d872-4261-a11d-4bc2ea572992 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:21.099741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695446-d872-4261-a11d-4bc2ea572992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:21.100466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695446-d872-4261-a11d-4bc2ea572992 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.domain.id=default, user.id=3854e1394dc743bfbab4ce7b02389426) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:21.100813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695446-d872-4261-a11d-4bc2ea572992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:21.102259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695446-d872-4261-a11d-4bc2ea572992 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:21.110745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Aug 9 12:08:20 2022] GET /identity/v3/role_assignments?user.id=3854e1394dc743bfbab4ce7b02389426&scope.domain.id=default&role.id=d6155b01aace49f887f29aa2861d31cf => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:22.610739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7ac1-6e48-4b6a-9f30-b5698cbdd329 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:22.611238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7ac1-6e48-4b6a-9f30-b5698cbdd329 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:22.611321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7ac1-6e48-4b6a-9f30-b5698cbdd329 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:22.612644 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 29/58] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:22.617786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68821-d552-486b-8d7d-102a5e2a5c6b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:22.618195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68821-d552-486b-8d7d-102a5e2a5c6b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:22.618339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68821-d552-486b-8d7d-102a5e2a5c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:22.636668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-37f68821-d552-486b-8d7d-102a5e2a5c6b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:22.637853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-37f68821-d552-486b-8d7d-102a5e2a5c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:22.701691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 30/59] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:22.725712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e7ac1-6e48-4b6a-9f30-b5698cbdd329 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:22.744365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:22.825038 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e7ac1-6e48-4b6a-9f30-b5698cbdd329 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:22.857508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9782b0f-6015-4825-9fb6-8128e080e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:22.858118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9782b0f-6015-4825-9fb6-8128e080e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:22.858397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9782b0f-6015-4825-9fb6-8128e080e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:22.858668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9782b0f-6015-4825-9fb6-8128e080e4a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:22.859973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9782b0f-6015-4825-9fb6-8128e080e4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:22.861426 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9782b0f-6015-4825-9fb6-8128e080e4a2 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:22.862974 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 30/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:22.868432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68821-d552-486b-8d7d-102a5e2a5c6b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:22.906717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:22.963666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68821-d552-486b-8d7d-102a5e2a5c6b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:22.995730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35263b-f8e1-43f0-99cc-49461fb66be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:22.996320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35263b-f8e1-43f0-99cc-49461fb66be1 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:22.996600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35263b-f8e1-43f0-99cc-49461fb66be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:22.996904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35263b-f8e1-43f0-99cc-49461fb66be1 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:22.997533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35263b-f8e1-43f0-99cc-49461fb66be1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:22.998979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35263b-f8e1-43f0-99cc-49461fb66be1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:23.024540 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 31/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:08:22 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:26.240058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a78481-71ae-4ad8-9ed8-763e34b09873 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.241070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a78481-71ae-4ad8-9ed8-763e34b09873 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.241361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a78481-71ae-4ad8-9ed8-763e34b09873 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.242940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 31/62] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:26.247908 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05158ab8-632f-45cf-8e38-28d11e58f604 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.248771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05158ab8-632f-45cf-8e38-28d11e58f604 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.249251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05158ab8-632f-45cf-8e38-28d11e58f604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.277633 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-05158ab8-632f-45cf-8e38-28d11e58f604 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:26.279196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-05158ab8-632f-45cf-8e38-28d11e58f604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:26.299696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c431-d1d5-45ef-8f2d-7b3614309e50 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.299993 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c431-d1d5-45ef-8f2d-7b3614309e50 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.300249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c431-d1d5-45ef-8f2d-7b3614309e50 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.301641 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:26.318170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ddc75-0f49-4884-aa05-c986b9ba9901 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.318737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ddc75-0f49-4884-aa05-c986b9ba9901 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.319209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ddc75-0f49-4884-aa05-c986b9ba9901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.357751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-108ddc75-0f49-4884-aa05-c986b9ba9901 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:26.358977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-108ddc75-0f49-4884-aa05-c986b9ba9901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:26.364592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 32/64] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:26.387624 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05158ab8-632f-45cf-8e38-28d11e58f604 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:26.432989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:26.496111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 33/65] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:26.519420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ddc75-0f49-4884-aa05-c986b9ba9901 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:26.535825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:26.565124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05158ab8-632f-45cf-8e38-28d11e58f604 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:26.600335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2fcca-931b-4c2c-98f7-39011c8b41ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:26.601073 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2fcca-931b-4c2c-98f7-39011c8b41ee None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.601360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2fcca-931b-4c2c-98f7-39011c8b41ee None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.601634 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2fcca-931b-4c2c-98f7-39011c8b41ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.612863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2fcca-931b-4c2c-98f7-39011c8b41ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-67a2fcca-931b-4c2c-98f7-39011c8b41ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:26.617563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:26.618407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:26.619230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 33/66] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:26.620341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be59a18-0799-4fc3-bcd5-a12769aa9fc7 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.620648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be59a18-0799-4fc3-bcd5-a12769aa9fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.620927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be59a18-0799-4fc3-bcd5-a12769aa9fc7 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.622189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 34/67] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:26.623513 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7cf4-f7bd-4ef3-9fe4-049920313b1a None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.623993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7cf4-f7bd-4ef3-9fe4-049920313b1a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.624271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b7cf4-f7bd-4ef3-9fe4-049920313b1a None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.626122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 35/68] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:26.627409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7cf4-f7bd-4ef3-9fe4-049920313b1a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:26.637289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ddc75-0f49-4884-aa05-c986b9ba9901 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:26.673923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc69c33-60dd-4883-8a37-515887719349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:26.674549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69c33-60dd-4883-8a37-515887719349 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.674825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69c33-60dd-4883-8a37-515887719349 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.675105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69c33-60dd-4883-8a37-515887719349 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.686187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc69c33-60dd-4883-8a37-515887719349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-9dc69c33-60dd-4883-8a37-515887719349 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:26.691905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:26.692996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:26.693730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:26.694368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d606f7-11ee-42e9-9aaf-4135a6d86c5b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.694438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d606f7-11ee-42e9-9aaf-4135a6d86c5b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.694846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d606f7-11ee-42e9-9aaf-4135a6d86c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.712974 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-34d606f7-11ee-42e9-9aaf-4135a6d86c5b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:26.714149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-34d606f7-11ee-42e9-9aaf-4135a6d86c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:26.721105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:26.741650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b7cf4-f7bd-4ef3-9fe4-049920313b1a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:26.776268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2febe9-1fe9-476c-a1cd-63f41110b05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:26.776829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2febe9-1fe9-476c-a1cd-63f41110b05c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.777108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2febe9-1fe9-476c-a1cd-63f41110b05c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.777377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2febe9-1fe9-476c-a1cd-63f41110b05c None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.778033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2febe9-1fe9-476c-a1cd-63f41110b05c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:26.778331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2febe9-1fe9-476c-a1cd-63f41110b05c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:26.779740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2febe9-1fe9-476c-a1cd-63f41110b05c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:26.783569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 35/70] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:26.784828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bbc6a-6e88-4c47-85c6-f08a14fa0f22 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.785115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bbc6a-6e88-4c47-85c6-f08a14fa0f22 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.785389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bbc6a-6e88-4c47-85c6-f08a14fa0f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.791963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:26.799387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:26.800230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2febe9-1fe9-476c-a1cd-63f41110b05c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:26.804538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-466bbc6a-6e88-4c47-85c6-f08a14fa0f22 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:26.805951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-466bbc6a-6e88-4c47-85c6-f08a14fa0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:26.871725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 36/72] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:26.873239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ee27-6d5a-43d8-aace-b9bb925b8720 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.873529 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ee27-6d5a-43d8-aace-b9bb925b8720 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.873803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ee27-6d5a-43d8-aace-b9bb925b8720 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.875080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 37/73] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:26.875766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ee27-6d5a-43d8-aace-b9bb925b8720 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:26.916446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2febe9-1fe9-476c-a1cd-63f41110b05c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:26.950213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4158d1-08d0-47ca-af0e-6dad64e7b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:26.950826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4158d1-08d0-47ca-af0e-6dad64e7b700 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:26.951104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4158d1-08d0-47ca-af0e-6dad64e7b700 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:26.951376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4158d1-08d0-47ca-af0e-6dad64e7b700 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:26.952036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4158d1-08d0-47ca-af0e-6dad64e7b700 None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:26.952611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4158d1-08d0-47ca-af0e-6dad64e7b700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:26.953934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4158d1-08d0-47ca-af0e-6dad64e7b700 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:26.961903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 37/74] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:26.964280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4158d1-08d0-47ca-af0e-6dad64e7b700 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:26.975526 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:26.977190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ee27-6d5a-43d8-aace-b9bb925b8720 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.010509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d0c9-fb03-4fea-b747-727a49779e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.011135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d0c9-fb03-4fea-b747-727a49779e3e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.011418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d0c9-fb03-4fea-b747-727a49779e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.011691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d0c9-fb03-4fea-b747-727a49779e3e None admin] PATH_INFO: `/v3/users/3854e1394dc743bfbab4ce7b02389426` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.012843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5d0c9-fb03-4fea-b747-727a49779e3e None admin] RBAC: Authorizing `identity:get_user(user_id=3854e1394dc743bfbab4ce7b02389426)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:27.014278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5d0c9-fb03-4fea-b747-727a49779e3e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:27.016011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:26 2022] GET /identity/v3/users/3854e1394dc743bfbab4ce7b02389426 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:27.017209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde3cbd-61cd-4965-bfc2-f9805ff5988c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.017493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde3cbd-61cd-4965-bfc2-f9805ff5988c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.017766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde3cbd-61cd-4965-bfc2-f9805ff5988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.023702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:27.036941 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4cde3cbd-61cd-4965-bfc2-f9805ff5988c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:27.038075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4cde3cbd-61cd-4965-bfc2-f9805ff5988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:27.064502 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4158d1-08d0-47ca-af0e-6dad64e7b700 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.097246 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff3724-46f0-420a-8ebc-dfac44da3383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.097871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff3724-46f0-420a-8ebc-dfac44da3383 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.098154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff3724-46f0-420a-8ebc-dfac44da3383 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.098427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff3724-46f0-420a-8ebc-dfac44da3383 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.103209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 39/76] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:27.104039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde3cbd-61cd-4965-bfc2-f9805ff5988c None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:27.108247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff3724-46f0-420a-8ebc-dfac44da3383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-2aff3724-46f0-420a-8ebc-dfac44da3383 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:27.114161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:27.115011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:27.115762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 38/77] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:08:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:27.117421 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff3724-46f0-420a-8ebc-dfac44da3383 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:27.182434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:27.211769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde3cbd-61cd-4965-bfc2-f9805ff5988c None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.214801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff3724-46f0-420a-8ebc-dfac44da3383 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.241324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:27.246543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff2668-a5fd-400b-ae0b-cabe411a9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.247201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff2668-a5fd-400b-ae0b-cabe411a9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.247477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff2668-a5fd-400b-ae0b-cabe411a9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.247747 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff2668-a5fd-400b-ae0b-cabe411a9ed2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.248688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8099c4-2d27-4ddb-8c80-074e780856e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.249316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8099c4-2d27-4ddb-8c80-074e780856e8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.249635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8099c4-2d27-4ddb-8c80-074e780856e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.250106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8099c4-2d27-4ddb-8c80-074e780856e8 None admin] PATH_INFO: `/v3/users/7641ad2083f64ed5abf305699dc5b1f7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.257784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff2668-a5fd-400b-ae0b-cabe411a9ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-bbff2668-a5fd-400b-ae0b-cabe411a9ed2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:27.262409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:27.263430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:27.264412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 40/78] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:27.268021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8099c4-2d27-4ddb-8c80-074e780856e8 None admin] RBAC: Authorizing `identity:get_user(user_id=7641ad2083f64ed5abf305699dc5b1f7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:27.269522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8099c4-2d27-4ddb-8c80-074e780856e8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:27.269633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff2668-a5fd-400b-ae0b-cabe411a9ed2 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:27.275478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 39/79] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:27 2022] GET /identity/v3/users/7641ad2083f64ed5abf305699dc5b1f7 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:27.275478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8099c4-2d27-4ddb-8c80-074e780856e8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:27.368580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff2668-a5fd-400b-ae0b-cabe411a9ed2 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.370349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8099c4-2d27-4ddb-8c80-074e780856e8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.397167 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:27.404270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf2f78-1de7-4341-9f34-5b6b42f6f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.404984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf2f78-1de7-4341-9f34-5b6b42f6f008 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.405266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf2f78-1de7-4341-9f34-5b6b42f6f008 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.405537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf2f78-1de7-4341-9f34-5b6b42f6f008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.407135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cc358-5197-4a16-998b-c129f26b579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.407747 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cc358-5197-4a16-998b-c129f26b579d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.408029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cc358-5197-4a16-998b-c129f26b579d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.408303 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cc358-5197-4a16-998b-c129f26b579d None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.409014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cc358-5197-4a16-998b-c129f26b579d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:27.410041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cc358-5197-4a16-998b-c129f26b579d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:27.410695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cc358-5197-4a16-998b-c129f26b579d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:27.420514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 40/80] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:08:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:27.421345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cc358-5197-4a16-998b-c129f26b579d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:27.469188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:27.479177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf2f78-1de7-4341-9f34-5b6b42f6f008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:27.480677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf2f78-1de7-4341-9f34-5b6b42f6f008 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:27.519122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cc358-5197-4a16-998b-c129f26b579d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.551763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21110964-1d6e-498f-bdc4-55cb42fb7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.552385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21110964-1d6e-498f-bdc4-55cb42fb7a8c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.552698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21110964-1d6e-498f-bdc4-55cb42fb7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.552978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21110964-1d6e-498f-bdc4-55cb42fb7a8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.554093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21110964-1d6e-498f-bdc4-55cb42fb7a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:27.555567 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21110964-1d6e-498f-bdc4-55cb42fb7a8c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:27.557169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 41/81] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:27.558006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21110964-1d6e-498f-bdc4-55cb42fb7a8c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:27.576939 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 41/82] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:27.578387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf2f78-1de7-4341-9f34-5b6b42f6f008 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:27.614280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:27.658310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21110964-1d6e-498f-bdc4-55cb42fb7a8c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.668032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:27.677368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf2f78-1de7-4341-9f34-5b6b42f6f008 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.691780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67d1f1-ff4c-4c14-a73b-c6186233831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.692389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67d1f1-ff4c-4c14-a73b-c6186233831c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.692694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67d1f1-ff4c-4c14-a73b-c6186233831c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.692967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67d1f1-ff4c-4c14-a73b-c6186233831c None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.693619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67d1f1-ff4c-4c14-a73b-c6186233831c None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:27.693926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67d1f1-ff4c-4c14-a73b-c6186233831c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:27.695284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67d1f1-ff4c-4c14-a73b-c6186233831c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:27.703768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 42/83] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:27.704551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67d1f1-ff4c-4c14-a73b-c6186233831c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:27.716135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a00502-d892-4c97-b6bb-d43cb10a3d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.716784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a00502-d892-4c97-b6bb-d43cb10a3d9f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.717070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a00502-d892-4c97-b6bb-d43cb10a3d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.717343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a00502-d892-4c97-b6bb-d43cb10a3d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.783797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a00502-d892-4c97-b6bb-d43cb10a3d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:27.785297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a00502-d892-4c97-b6bb-d43cb10a3d9f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:27.801170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67d1f1-ff4c-4c14-a73b-c6186233831c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.819829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:27.836560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c142d8-0d8b-4bfd-b3ca-cddde507ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.837227 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c142d8-0d8b-4bfd-b3ca-cddde507ed4a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.837505 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c142d8-0d8b-4bfd-b3ca-cddde507ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.837784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c142d8-0d8b-4bfd-b3ca-cddde507ed4a None admin] PATH_INFO: `/v3/users/7641ad2083f64ed5abf305699dc5b1f7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.838920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c142d8-0d8b-4bfd-b3ca-cddde507ed4a None admin] RBAC: Authorizing `identity:get_user(user_id=7641ad2083f64ed5abf305699dc5b1f7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:27.840401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c142d8-0d8b-4bfd-b3ca-cddde507ed4a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:27.842016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 43/84] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:27 2022] GET /identity/v3/users/7641ad2083f64ed5abf305699dc5b1f7 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:27.842922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c142d8-0d8b-4bfd-b3ca-cddde507ed4a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:27.875874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:27.885456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 42/85] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:27.886264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a00502-d892-4c97-b6bb-d43cb10a3d9f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:27.942114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c142d8-0d8b-4bfd-b3ca-cddde507ed4a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:27.974950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6b754-1e8f-40f7-b571-3c7fbc56d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:27.975552 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6b754-1e8f-40f7-b571-3c7fbc56d31f None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:27.975837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6b754-1e8f-40f7-b571-3c7fbc56d31f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:27.976111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6b754-1e8f-40f7-b571-3c7fbc56d31f None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:27.976785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6b754-1e8f-40f7-b571-3c7fbc56d31f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:27.978225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6b754-1e8f-40f7-b571-3c7fbc56d31f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:27.983958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a00502-d892-4c97-b6bb-d43cb10a3d9f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:28.008717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 44/86] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:08:27 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:28.008717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6b754-1e8f-40f7-b571-3c7fbc56d31f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:28.025501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ad875-7fd4-4278-aee2-8a49385658e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:28.026357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ad875-7fd4-4278-aee2-8a49385658e8 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:28.026638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ad875-7fd4-4278-aee2-8a49385658e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:28.026920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ad875-7fd4-4278-aee2-8a49385658e8 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:28.028202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ad875-7fd4-4278-aee2-8a49385658e8 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:28.030253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ad875-7fd4-4278-aee2-8a49385658e8 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:28.037577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 43/87] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:27 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:28.037577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ad875-7fd4-4278-aee2-8a49385658e8 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:28.057356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:28.108984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:28.127164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6b754-1e8f-40f7-b571-3c7fbc56d31f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:28.159817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ad875-7fd4-4278-aee2-8a49385658e8 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:28.167962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc61181-9dc8-47e4-9da1-838c22d41b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:28.168599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc61181-9dc8-47e4-9da1-838c22d41b65 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:28.168929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc61181-9dc8-47e4-9da1-838c22d41b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:28.169201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc61181-9dc8-47e4-9da1-838c22d41b65 None admin] PATH_INFO: `/v3/users/7641ad2083f64ed5abf305699dc5b1f7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:28.170498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc61181-9dc8-47e4-9da1-838c22d41b65 None admin] RBAC: Authorizing `identity:get_user(user_id=7641ad2083f64ed5abf305699dc5b1f7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:28.172942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc61181-9dc8-47e4-9da1-838c22d41b65 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:28.174498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 45/88] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:27 2022] GET /identity/v3/users/7641ad2083f64ed5abf305699dc5b1f7 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:28.175486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc61181-9dc8-47e4-9da1-838c22d41b65 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:28.201634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e99a8-7eda-4932-84e0-8a6640df2e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:28.202564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e99a8-7eda-4932-84e0-8a6640df2e8b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:28.203602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e99a8-7eda-4932-84e0-8a6640df2e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:28.203881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e99a8-7eda-4932-84e0-8a6640df2e8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:28.300289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc61181-9dc8-47e4-9da1-838c22d41b65 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:28.301722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e99a8-7eda-4932-84e0-8a6640df2e8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:28.304171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e99a8-7eda-4932-84e0-8a6640df2e8b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:28.312308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:28.339847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b331a86-9f84-403b-ac0f-dda1f2995c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:28.340982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b331a86-9f84-403b-ac0f-dda1f2995c10 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:28.341563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b331a86-9f84-403b-ac0f-dda1f2995c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:28.342037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b331a86-9f84-403b-ac0f-dda1f2995c10 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:28.343467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b331a86-9f84-403b-ac0f-dda1f2995c10 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:28.346119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b331a86-9f84-403b-ac0f-dda1f2995c10 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:28.348424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 46/89] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:28 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:28.353593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b331a86-9f84-403b-ac0f-dda1f2995c10 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:28.373470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:28.430840 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 44/90] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:28.431543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e99a8-7eda-4932-84e0-8a6640df2e8b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:28.468453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b331a86-9f84-403b-ac0f-dda1f2995c10 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:28.509209 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23dc37-8959-4496-8435-d3202e4441b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:28.510242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23dc37-8959-4496-8435-d3202e4441b7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:28.510743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23dc37-8959-4496-8435-d3202e4441b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:28.511212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23dc37-8959-4496-8435-d3202e4441b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:28.512133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23dc37-8959-4496-8435-d3202e4441b7 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=bd32494f9acf41b2af293e24ff51e99a, user.id=3854e1394dc743bfbab4ce7b02389426) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:28.512766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23dc37-8959-4496-8435-d3202e4441b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:28.514516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23dc37-8959-4496-8435-d3202e4441b7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:28.521833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 47/91] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:28 2022] GET /identity/v3/role_assignments?user.id=3854e1394dc743bfbab4ce7b02389426&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=d6155b01aace49f887f29aa2861d31cf => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:28.522947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23dc37-8959-4496-8435-d3202e4441b7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:28.557474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e99a8-7eda-4932-84e0-8a6640df2e8b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:28.578692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:28.601328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95862203-272a-4b2e-873b-50833c879b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:28.601328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862203-272a-4b2e-873b-50833c879b40 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:28.601629 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862203-272a-4b2e-873b-50833c879b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:28.601858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862203-272a-4b2e-873b-50833c879b40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:28.637164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:28.679433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95862203-272a-4b2e-873b-50833c879b40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:28.681339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95862203-272a-4b2e-873b-50833c879b40 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:28.681580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23dc37-8959-4496-8435-d3202e4441b7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:28.722880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516048ca-f173-4a9a-834f-61f5f05a304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:28.722880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516048ca-f173-4a9a-834f-61f5f05a304f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:28.722880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516048ca-f173-4a9a-834f-61f5f05a304f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:28.722880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516048ca-f173-4a9a-834f-61f5f05a304f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:28.725214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516048ca-f173-4a9a-834f-61f5f05a304f None admin] RBAC: Adding query filter params (role.id=12dc9c7d75da4722bf4525a56eea0e47, scope.project.id=bd32494f9acf41b2af293e24ff51e99a, user.id=7641ad2083f64ed5abf305699dc5b1f7) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:28.725214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516048ca-f173-4a9a-834f-61f5f05a304f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:28.725370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516048ca-f173-4a9a-834f-61f5f05a304f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:28.731788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 48/92] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:28 2022] GET /identity/v3/role_assignments?user.id=7641ad2083f64ed5abf305699dc5b1f7&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:28.732604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516048ca-f173-4a9a-834f-61f5f05a304f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:28.794800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 45/93] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:28.801462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95862203-272a-4b2e-873b-50833c879b40 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:28.850410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516048ca-f173-4a9a-834f-61f5f05a304f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:28.865088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:28.865633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:28.890809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38378be-a0d7-4d39-9cd5-ca1481ceea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:28.891804 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38378be-a0d7-4d39-9cd5-ca1481ceea6e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:28.892080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38378be-a0d7-4d39-9cd5-ca1481ceea6e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:28.892355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38378be-a0d7-4d39-9cd5-ca1481ceea6e None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:28.893660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38378be-a0d7-4d39-9cd5-ca1481ceea6e None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:28.895198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38378be-a0d7-4d39-9cd5-ca1481ceea6e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:28.897078 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 49/94] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:28 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:28.903128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38378be-a0d7-4d39-9cd5-ca1481ceea6e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:28.910824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95862203-272a-4b2e-873b-50833c879b40 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:28.946602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6efc8e-c025-479d-afeb-1c4176aa81b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:28.947257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6efc8e-c025-479d-afeb-1c4176aa81b1 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:28.947539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6efc8e-c025-479d-afeb-1c4176aa81b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:28.947810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6efc8e-c025-479d-afeb-1c4176aa81b1 None admin] PATH_INFO: `/v3/projects/c710bb205c7a46e899a86be8e75a85d8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:28.949025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6efc8e-c025-479d-afeb-1c4176aa81b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c710bb205c7a46e899a86be8e75a85d8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:28.950512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6efc8e-c025-479d-afeb-1c4176aa81b1 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:28.952206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 46/95] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:28 2022] GET /identity/v3/projects/c710bb205c7a46e899a86be8e75a85d8 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:28.959135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6efc8e-c025-479d-afeb-1c4176aa81b1 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:29.017878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38378be-a0d7-4d39-9cd5-ca1481ceea6e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:29.055964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92138cc9-8cd2-47b1-9cbe-2d1509af4337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:29.056713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92138cc9-8cd2-47b1-9cbe-2d1509af4337 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:29.057000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92138cc9-8cd2-47b1-9cbe-2d1509af4337 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:29.057510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92138cc9-8cd2-47b1-9cbe-2d1509af4337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:29.058309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92138cc9-8cd2-47b1-9cbe-2d1509af4337 None admin] RBAC: Adding query filter params (role.id=c6822f728eca477f81827dcc4c547bd0, scope.project.id=bd32494f9acf41b2af293e24ff51e99a, user.id=7641ad2083f64ed5abf305699dc5b1f7) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:29.058628 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92138cc9-8cd2-47b1-9cbe-2d1509af4337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:29.060312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92138cc9-8cd2-47b1-9cbe-2d1509af4337 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:29.067270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 50/96] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:28 2022] GET /identity/v3/role_assignments?user.id=7641ad2083f64ed5abf305699dc5b1f7&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=c6822f728eca477f81827dcc4c547bd0 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:29.067546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6efc8e-c025-479d-afeb-1c4176aa81b1 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:29.099924 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:29.114001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe6401-63dc-4fed-8a6f-20a4346ce82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:29.114633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe6401-63dc-4fed-8a6f-20a4346ce82b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:29.114913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe6401-63dc-4fed-8a6f-20a4346ce82b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:29.115188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe6401-63dc-4fed-8a6f-20a4346ce82b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:29.115929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe6401-63dc-4fed-8a6f-20a4346ce82b None admin] RBAC: Adding query filter params (role.id=12dc9c7d75da4722bf4525a56eea0e47, scope.project.id=c710bb205c7a46e899a86be8e75a85d8, user.id=7641ad2083f64ed5abf305699dc5b1f7) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:29.116240 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe6401-63dc-4fed-8a6f-20a4346ce82b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:29.117765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe6401-63dc-4fed-8a6f-20a4346ce82b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:29.124242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 47/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:28 2022] GET /identity/v3/role_assignments?user.id=7641ad2083f64ed5abf305699dc5b1f7&scope.project.id=c710bb205c7a46e899a86be8e75a85d8&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:30.877857 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f371b-56d9-4d61-9b9b-c27c75766e8d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:30.878893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f371b-56d9-4d61-9b9b-c27c75766e8d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:30.879395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f371b-56d9-4d61-9b9b-c27c75766e8d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:30.881291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 51/98] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:30.886600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da82c63-d632-4458-bc63-c538fe077254 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:30.887393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da82c63-d632-4458-bc63-c538fe077254 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:30.887897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da82c63-d632-4458-bc63-c538fe077254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:30.907610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-3da82c63-d632-4458-bc63-c538fe077254 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:30.909124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3da82c63-d632-4458-bc63-c538fe077254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:30.977899 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 48/99] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:31.027928 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f371b-56d9-4d61-9b9b-c27c75766e8d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:31.060916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15a69-7e42-4a18-b83e-7d3c07d9c1f4 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.061557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15a69-7e42-4a18-b83e-7d3c07d9c1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.062027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15a69-7e42-4a18-b83e-7d3c07d9c1f4 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.064395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 49/100] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:31.069483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244eb40-f0b4-4776-9613-fb06e3c77fb2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.069989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244eb40-f0b4-4776-9613-fb06e3c77fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.070485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244eb40-f0b4-4776-9613-fb06e3c77fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.078301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:31.094278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d244eb40-f0b4-4776-9613-fb06e3c77fb2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:31.095785 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d244eb40-f0b4-4776-9613-fb06e3c77fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:31.144048 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f371b-56d9-4d61-9b9b-c27c75766e8d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:31.181055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6e78e-8f2c-4593-be52-a8faca3e0751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:31.181697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6e78e-8f2c-4593-be52-a8faca3e0751 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.181987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6e78e-8f2c-4593-be52-a8faca3e0751 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.182245 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6e78e-8f2c-4593-be52-a8faca3e0751 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.183354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6e78e-8f2c-4593-be52-a8faca3e0751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:31.185033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6e78e-8f2c-4593-be52-a8faca3e0751 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:31.188669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 52/101] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:31.193656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6e78e-8f2c-4593-be52-a8faca3e0751 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:31.215072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 50/102] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:31.254799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244eb40-f0b4-4776-9613-fb06e3c77fb2 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:31.300300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6e78e-8f2c-4593-be52-a8faca3e0751 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:31.313266 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:31.352830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:31.358494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70ea12-5577-4c35-8650-32dbc9c7d75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:31.359683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70ea12-5577-4c35-8650-32dbc9c7d75c None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.359965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70ea12-5577-4c35-8650-32dbc9c7d75c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.360237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70ea12-5577-4c35-8650-32dbc9c7d75c None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.360911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70ea12-5577-4c35-8650-32dbc9c7d75c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:31.362363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70ea12-5577-4c35-8650-32dbc9c7d75c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:31.403976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 53/103] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:08:31 2022] POST /identity/v3/projects => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:08:31.433337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244eb40-f0b4-4776-9613-fb06e3c77fb2 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:31.471170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56340434-cbb0-44a0-8af7-44677ef36409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:31.471978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340434-cbb0-44a0-8af7-44677ef36409 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.472302 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340434-cbb0-44a0-8af7-44677ef36409 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.472578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340434-cbb0-44a0-8af7-44677ef36409 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.484057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56340434-cbb0-44a0-8af7-44677ef36409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-56340434-cbb0-44a0-8af7-44677ef36409 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:31.489604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:31.490434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:31.491210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 51/104] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:31.498572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70ea12-5577-4c35-8650-32dbc9c7d75c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:31.632033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70ea12-5577-4c35-8650-32dbc9c7d75c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:31.669730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c65c2-565a-40c9-a7a9-e58bd7dfd77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:31.670272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c65c2-565a-40c9-a7a9-e58bd7dfd77a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.670552 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c65c2-565a-40c9-a7a9-e58bd7dfd77a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.670824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c65c2-565a-40c9-a7a9-e58bd7dfd77a None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.671539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c65c2-565a-40c9-a7a9-e58bd7dfd77a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:31.671841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c65c2-565a-40c9-a7a9-e58bd7dfd77a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:31.673551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c65c2-565a-40c9-a7a9-e58bd7dfd77a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:31.682905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 54/105] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:31.689929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56340434-cbb0-44a0-8af7-44677ef36409 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:31.745892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130b61-f77c-403b-8fa9-c0946c53a876 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.746194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130b61-f77c-403b-8fa9-c0946c53a876 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.746478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130b61-f77c-403b-8fa9-c0946c53a876 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.748038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 55/106] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:31.754108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f1663-bd62-4f58-9c98-c81fb77a9668 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.754691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f1663-bd62-4f58-9c98-c81fb77a9668 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.755169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f1663-bd62-4f58-9c98-c81fb77a9668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.785459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-605f1663-bd62-4f58-9c98-c81fb77a9668 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:31.788294 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-605f1663-bd62-4f58-9c98-c81fb77a9668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:31.818639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:31.849756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56340434-cbb0-44a0-8af7-44677ef36409 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:31.873894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:31.899795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 56/107] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:31.900366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688e8b1-9a70-4e2c-877e-63ec67319197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:31.901165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688e8b1-9a70-4e2c-877e-63ec67319197 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.901510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688e8b1-9a70-4e2c-877e-63ec67319197 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.901863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688e8b1-9a70-4e2c-877e-63ec67319197 None admin] PATH_INFO: `/v3/users/2d53f52b9a784862b9015d65016259e6` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.902779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99521e-e163-4c46-8342-a893b9c536a9 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.903286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99521e-e163-4c46-8342-a893b9c536a9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.903728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99521e-e163-4c46-8342-a893b9c536a9 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.909316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 57/108] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:31.916479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29bf78-9a3a-4fef-9413-093f14d03893 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.917010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29bf78-9a3a-4fef-9413-093f14d03893 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.917462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29bf78-9a3a-4fef-9413-093f14d03893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.924712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688e8b1-9a70-4e2c-877e-63ec67319197 None admin] RBAC: Authorizing `identity:get_user(user_id=2d53f52b9a784862b9015d65016259e6)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:31.924712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688e8b1-9a70-4e2c-877e-63ec67319197 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:31.925634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 52/109] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:31 2022] GET /identity/v3/users/2d53f52b9a784862b9015d65016259e6 => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:31.931291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688e8b1-9a70-4e2c-877e-63ec67319197 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:31.950237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9e29bf78-9a3a-4fef-9413-093f14d03893 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:31.951750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9e29bf78-9a3a-4fef-9413-093f14d03893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:32.028220 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 58/110] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:32.029195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29bf78-9a3a-4fef-9413-093f14d03893 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.095760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688e8b1-9a70-4e2c-877e-63ec67319197 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.127216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:32.147161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29bf78-9a3a-4fef-9413-093f14d03893 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.184737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8765c96-d61c-4d30-bccb-60319a2b8dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:32.185321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8765c96-d61c-4d30-bccb-60319a2b8dfb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.185601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8765c96-d61c-4d30-bccb-60319a2b8dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.185876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8765c96-d61c-4d30-bccb-60319a2b8dfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.186360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26527148-db16-4cc4-82e0-ac1f25cfdf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:32.187305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26527148-db16-4cc4-82e0-ac1f25cfdf2c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.188030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26527148-db16-4cc4-82e0-ac1f25cfdf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.188528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26527148-db16-4cc4-82e0-ac1f25cfdf2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.200658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8765c96-d61c-4d30-bccb-60319a2b8dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f8765c96-d61c-4d30-bccb-60319a2b8dfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:32.201547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:32.202385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:32.203545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 59/111] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:32.204840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8765c96-d61c-4d30-bccb-60319a2b8dfb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.260607 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:32.299119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26527148-db16-4cc4-82e0-ac1f25cfdf2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:32.301453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26527148-db16-4cc4-82e0-ac1f25cfdf2c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:32.315872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8765c96-d61c-4d30-bccb-60319a2b8dfb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.359799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569e8e8-913e-4949-b403-0a6f59a6aa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:32.360527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569e8e8-913e-4949-b403-0a6f59a6aa29 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.360922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569e8e8-913e-4949-b403-0a6f59a6aa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.361260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569e8e8-913e-4949-b403-0a6f59a6aa29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.369517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:32.373203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569e8e8-913e-4949-b403-0a6f59a6aa29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-b569e8e8-913e-4949-b403-0a6f59a6aa29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:32.378341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:32.379344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:32.380254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:32.382556 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 60/112] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:32.383529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a117b-7966-4a7f-b8c1-b48a10f616b5 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.383809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a117b-7966-4a7f-b8c1-b48a10f616b5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.384080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a117b-7966-4a7f-b8c1-b48a10f616b5 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.385587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 61/113] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:32.386742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a117b-7966-4a7f-b8c1-b48a10f616b5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.431415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 53/114] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:32.432029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26527148-db16-4cc4-82e0-ac1f25cfdf2c None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.503669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a117b-7966-4a7f-b8c1-b48a10f616b5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.505768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:32.540763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb40ab-c1c4-4fa6-aa49-cf2367ea9ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:32.541380 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb40ab-c1c4-4fa6-aa49-cf2367ea9ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.541675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb40ab-c1c4-4fa6-aa49-cf2367ea9ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.541944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb40ab-c1c4-4fa6-aa49-cf2367ea9ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.542614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb40ab-c1c4-4fa6-aa49-cf2367ea9ef6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:32.542939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb40ab-c1c4-4fa6-aa49-cf2367ea9ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:32.544304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb40ab-c1c4-4fa6-aa49-cf2367ea9ef6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:32.546057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26527148-db16-4cc4-82e0-ac1f25cfdf2c None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.555557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 62/115] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:32.555557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5fc3-77a8-48a3-aee4-1ba4a370bbf8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.555557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5fc3-77a8-48a3-aee4-1ba4a370bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.555557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5fc3-77a8-48a3-aee4-1ba4a370bbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.572398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bf3a5fc3-77a8-48a3-aee4-1ba4a370bbf8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:32.573627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bf3a5fc3-77a8-48a3-aee4-1ba4a370bbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:32.586322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b66239-4a45-4a78-8c4d-ac7e7cbcdf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:32.586908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b66239-4a45-4a78-8c4d-ac7e7cbcdf61 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.587185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b66239-4a45-4a78-8c4d-ac7e7cbcdf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.587442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b66239-4a45-4a78-8c4d-ac7e7cbcdf61 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.588094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b66239-4a45-4a78-8c4d-ac7e7cbcdf61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:32.588391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b66239-4a45-4a78-8c4d-ac7e7cbcdf61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:32.589804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b66239-4a45-4a78-8c4d-ac7e7cbcdf61 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:32.606475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 54/116] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:32.606475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333940-5efc-4d99-9f89-2eeb73bfd3bb None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.606475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333940-5efc-4d99-9f89-2eeb73bfd3bb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.606475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333940-5efc-4d99-9f89-2eeb73bfd3bb None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.606475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 55/117] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:32.606475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29333940-5efc-4d99-9f89-2eeb73bfd3bb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.642271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:32.655416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 63/118] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:32.657352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5fc3-77a8-48a3-aee4-1ba4a370bbf8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.713155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29333940-5efc-4d99-9f89-2eeb73bfd3bb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.749627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:32.755131 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e2269-22b0-48ab-97ba-90304136207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:32.756106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e2269-22b0-48ab-97ba-90304136207e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.756399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e2269-22b0-48ab-97ba-90304136207e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.756709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e2269-22b0-48ab-97ba-90304136207e None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.757984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e2269-22b0-48ab-97ba-90304136207e None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:32.759431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e2269-22b0-48ab-97ba-90304136207e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:32.766660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 56/119] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:32.766660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683515e-da64-4ec6-bacb-3ae3ba865b79 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.766660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683515e-da64-4ec6-bacb-3ae3ba865b79 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.766660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683515e-da64-4ec6-bacb-3ae3ba865b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.774937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5fc3-77a8-48a3-aee4-1ba4a370bbf8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.780384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-e683515e-da64-4ec6-bacb-3ae3ba865b79 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:32.782235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e683515e-da64-4ec6-bacb-3ae3ba865b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:32.813680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcf2d7-73d5-48d8-b78c-f28e1c4dcb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:32.814395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcf2d7-73d5-48d8-b78c-f28e1c4dcb0a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.814747 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcf2d7-73d5-48d8-b78c-f28e1c4dcb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.815089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcf2d7-73d5-48d8-b78c-f28e1c4dcb0a None admin] PATH_INFO: `/v3/users/7641ad2083f64ed5abf305699dc5b1f7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.816273 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcf2d7-73d5-48d8-b78c-f28e1c4dcb0a None admin] RBAC: Authorizing `identity:get_user(user_id=7641ad2083f64ed5abf305699dc5b1f7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:32.818083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcf2d7-73d5-48d8-b78c-f28e1c4dcb0a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:32.823863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 64/120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/users/7641ad2083f64ed5abf305699dc5b1f7 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:32.823863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcf2d7-73d5-48d8-b78c-f28e1c4dcb0a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.854289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 57/121] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:32.855010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683515e-da64-4ec6-bacb-3ae3ba865b79 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.899002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:32.942100 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcf2d7-73d5-48d8-b78c-f28e1c4dcb0a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.959408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683515e-da64-4ec6-bacb-3ae3ba865b79 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.979418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d63a3-59e9-43a9-be50-cac422029dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:32.980172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d63a3-59e9-43a9-be50-cac422029dce None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.980452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d63a3-59e9-43a9-be50-cac422029dce None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.980762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d63a3-59e9-43a9-be50-cac422029dce None admin] PATH_INFO: `/v3/users/7641ad2083f64ed5abf305699dc5b1f7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.981867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d63a3-59e9-43a9-be50-cac422029dce None admin] RBAC: Authorizing `identity:get_user(user_id=7641ad2083f64ed5abf305699dc5b1f7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:32.983512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d63a3-59e9-43a9-be50-cac422029dce None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:32.989742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 65/122] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/users/7641ad2083f64ed5abf305699dc5b1f7 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:32.989742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d63a3-59e9-43a9-be50-cac422029dce None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.994078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:33.001436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a9368-4012-4c68-85ac-e758463c97e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:33.002070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9368-4012-4c68-85ac-e758463c97e7 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:33.002351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9368-4012-4c68-85ac-e758463c97e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:33.002641 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9368-4012-4c68-85ac-e758463c97e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:33.013000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a9368-4012-4c68-85ac-e758463c97e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-fc8a9368-4012-4c68-85ac-e758463c97e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:33.018235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:33.019083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 58/123] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:33.024794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a9368-4012-4c68-85ac-e758463c97e7 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:33.110219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d63a3-59e9-43a9-be50-cac422029dce None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:33.125094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a9368-4012-4c68-85ac-e758463c97e7 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:33.138480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:33.147035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faa68a-5b1f-49de-81b9-cd176c46f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:33.147645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa68a-5b1f-49de-81b9-cd176c46f9bc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:33.147926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa68a-5b1f-49de-81b9-cd176c46f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:33.148201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa68a-5b1f-49de-81b9-cd176c46f9bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:33.148964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faa68a-5b1f-49de-81b9-cd176c46f9bc None admin] RBAC: Adding query filter params (role.id=907e76e063c343839d29a28f402e588b, scope.project.id=bd32494f9acf41b2af293e24ff51e99a, user.id=2d53f52b9a784862b9015d65016259e6) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:33.149274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faa68a-5b1f-49de-81b9-cd176c46f9bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:33.150730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faa68a-5b1f-49de-81b9-cd176c46f9bc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:33.164665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 66/124] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/role_assignments?user.id=2d53f52b9a784862b9015d65016259e6&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=907e76e063c343839d29a28f402e588b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:33.164665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faa68a-5b1f-49de-81b9-cd176c46f9bc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:33.175928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd3e18-d885-4878-8226-751800334ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:33.176789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd3e18-d885-4878-8226-751800334ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:33.177075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd3e18-d885-4878-8226-751800334ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:33.177688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd3e18-d885-4878-8226-751800334ef3 None admin] PATH_INFO: `/v3/projects/c710bb205c7a46e899a86be8e75a85d8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:33.178915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd3e18-d885-4878-8226-751800334ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=c710bb205c7a46e899a86be8e75a85d8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:33.180434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd3e18-d885-4878-8226-751800334ef3 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:33.183251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 59/125] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:33 2022] GET /identity/v3/projects/c710bb205c7a46e899a86be8e75a85d8 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:33.184351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd3e18-d885-4878-8226-751800334ef3 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:33.263341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:33.271652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faa68a-5b1f-49de-81b9-cd176c46f9bc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:33.311337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515d3f6-bdc9-458b-92cb-f08f2466d9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:33.312145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515d3f6-bdc9-458b-92cb-f08f2466d9cf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:33.313218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515d3f6-bdc9-458b-92cb-f08f2466d9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:33.313570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515d3f6-bdc9-458b-92cb-f08f2466d9cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:33.314767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd3e18-d885-4878-8226-751800334ef3 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:33.326382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515d3f6-bdc9-458b-92cb-f08f2466d9cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3515d3f6-bdc9-458b-92cb-f08f2466d9cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:33.332487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:33.333570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:33.334410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:33.335021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 67/126] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:33.335494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515d3f6-bdc9-458b-92cb-f08f2466d9cf None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:33.357817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7578-2dc6-450a-892a-db7919da37de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:33.358605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7578-2dc6-450a-892a-db7919da37de None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:33.359458 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7578-2dc6-450a-892a-db7919da37de None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:33.359837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7578-2dc6-450a-892a-db7919da37de None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:33.361453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7578-2dc6-450a-892a-db7919da37de None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:33.363721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7578-2dc6-450a-892a-db7919da37de None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:33.366161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 60/127] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:33 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:33.371514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7578-2dc6-450a-892a-db7919da37de None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:33.409488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:33.466328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515d3f6-bdc9-458b-92cb-f08f2466d9cf None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:33.482306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7578-2dc6-450a-892a-db7919da37de None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:33.509709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ac625-4da2-440e-aa0d-9aa73a401981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:33.510325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ac625-4da2-440e-aa0d-9aa73a401981 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:33.510608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ac625-4da2-440e-aa0d-9aa73a401981 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:33.510885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ac625-4da2-440e-aa0d-9aa73a401981 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:33.511654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:33.512709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ac625-4da2-440e-aa0d-9aa73a401981 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:33.513663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ac625-4da2-440e-aa0d-9aa73a401981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:33.515137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ac625-4da2-440e-aa0d-9aa73a401981 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:33.523794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07aa45d-b7e3-4a0f-9e38-eec188751054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:33.524759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aa45d-b7e3-4a0f-9e38-eec188751054 None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:33.525384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aa45d-b7e3-4a0f-9e38-eec188751054 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:33.525855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aa45d-b7e3-4a0f-9e38-eec188751054 None admin] PATH_INFO: `/v3/projects/c710bb205c7a46e899a86be8e75a85d8/users/7641ad2083f64ed5abf305699dc5b1f7/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:33.527286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 68/128] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:33.528305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ac625-4da2-440e-aa0d-9aa73a401981 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:33.528749 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07aa45d-b7e3-4a0f-9e38-eec188751054 None admin] RBAC: Authorizing `identity:create_grant(project_id=c710bb205c7a46e899a86be8e75a85d8, user_id=7641ad2083f64ed5abf305699dc5b1f7, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:33.530867 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07aa45d-b7e3-4a0f-9e38-eec188751054 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:33.550901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 61/129] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:33 2022] PUT /identity/v3/projects/c710bb205c7a46e899a86be8e75a85d8/users/7641ad2083f64ed5abf305699dc5b1f7/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:33.552368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07aa45d-b7e3-4a0f-9e38-eec188751054 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:33.654467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ac625-4da2-440e-aa0d-9aa73a401981 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:33.672702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:33.725837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70439f5f-d86b-4aa9-9b4e-b153f1945d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:33.726839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70439f5f-d86b-4aa9-9b4e-b153f1945d28 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:33.727320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70439f5f-d86b-4aa9-9b4e-b153f1945d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:33.727833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70439f5f-d86b-4aa9-9b4e-b153f1945d28 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:33.728743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70439f5f-d86b-4aa9-9b4e-b153f1945d28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:33.729728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70439f5f-d86b-4aa9-9b4e-b153f1945d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:33.731549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70439f5f-d86b-4aa9-9b4e-b153f1945d28 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:33.745211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07aa45d-b7e3-4a0f-9e38-eec188751054 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:33.751055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 69/130] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:33.753266 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70439f5f-d86b-4aa9-9b4e-b153f1945d28 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:33.809813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de3f02-b8a4-4947-bea5-3ae89f00571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:33.810823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3f02-b8a4-4947-bea5-3ae89f00571a None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:33.811320 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3f02-b8a4-4947-bea5-3ae89f00571a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:33.811795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3f02-b8a4-4947-bea5-3ae89f00571a None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a/users/7641ad2083f64ed5abf305699dc5b1f7/roles/c6822f728eca477f81827dcc4c547bd0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:33.816934 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de3f02-b8a4-4947-bea5-3ae89f00571a None admin] RBAC: Authorizing `identity:create_grant(project_id=bd32494f9acf41b2af293e24ff51e99a, user_id=7641ad2083f64ed5abf305699dc5b1f7, role_id=c6822f728eca477f81827dcc4c547bd0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:33.818655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de3f02-b8a4-4947-bea5-3ae89f00571a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:33.837333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 62/131] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:33 2022] PUT /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a/users/7641ad2083f64ed5abf305699dc5b1f7/roles/c6822f728eca477f81827dcc4c547bd0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:33.838606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de3f02-b8a4-4947-bea5-3ae89f00571a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:33.893109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70439f5f-d86b-4aa9-9b4e-b153f1945d28 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:33.910990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:33.932156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff066-5026-4fdf-8569-6cb894a23e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:33.933094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff066-5026-4fdf-8569-6cb894a23e6b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:33.933544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff066-5026-4fdf-8569-6cb894a23e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:33.933943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff066-5026-4fdf-8569-6cb894a23e6b None admin] PATH_INFO: `/v3/users/3854e1394dc743bfbab4ce7b02389426` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:33.935391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ff066-5026-4fdf-8569-6cb894a23e6b None admin] RBAC: Authorizing `identity:get_user(user_id=3854e1394dc743bfbab4ce7b02389426)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:33.937621 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ff066-5026-4fdf-8569-6cb894a23e6b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:33.939585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 70/132] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:33 2022] GET /identity/v3/users/3854e1394dc743bfbab4ce7b02389426 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:33.946474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff066-5026-4fdf-8569-6cb894a23e6b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:34.031541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de3f02-b8a4-4947-bea5-3ae89f00571a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:34.037402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:34.105917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79633aba-c938-4f9c-80ea-c48c050ecf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:34.106563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633aba-c938-4f9c-80ea-c48c050ecf1a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.106845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633aba-c938-4f9c-80ea-c48c050ecf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.107120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633aba-c938-4f9c-80ea-c48c050ecf1a None admin] PATH_INFO: `/v3/users/7641ad2083f64ed5abf305699dc5b1f7` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.109934 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79633aba-c938-4f9c-80ea-c48c050ecf1a None admin] RBAC: Authorizing `identity:get_user(user_id=7641ad2083f64ed5abf305699dc5b1f7)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:34.111822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79633aba-c938-4f9c-80ea-c48c050ecf1a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:34.113816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 63/133] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:33 2022] GET /identity/v3/users/7641ad2083f64ed5abf305699dc5b1f7 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:34.120227 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38598c85-7c2d-4db6-b313-e424052f46fe None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.120554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38598c85-7c2d-4db6-b313-e424052f46fe None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.120825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38598c85-7c2d-4db6-b313-e424052f46fe None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.122269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 64/134] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:34.123023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38598c85-7c2d-4db6-b313-e424052f46fe None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:34.152512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff066-5026-4fdf-8569-6cb894a23e6b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:34.200444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154140b6-e0a8-43bc-8c01-bb52c766fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:34.201790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154140b6-e0a8-43bc-8c01-bb52c766fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.203300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154140b6-e0a8-43bc-8c01-bb52c766fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.203777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154140b6-e0a8-43bc-8c01-bb52c766fdd7 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.205357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154140b6-e0a8-43bc-8c01-bb52c766fdd7 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:34.207925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154140b6-e0a8-43bc-8c01-bb52c766fdd7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:34.210889 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 71/135] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:33 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:34.212893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b172ea9-9d3c-4429-8874-030856d297bc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.213145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b172ea9-9d3c-4429-8874-030856d297bc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.213413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b172ea9-9d3c-4429-8874-030856d297bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.240109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6b172ea9-9d3c-4429-8874-030856d297bc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:34.241338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6b172ea9-9d3c-4429-8874-030856d297bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:34.314061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 72/136] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:34.314901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b172ea9-9d3c-4429-8874-030856d297bc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:34.337298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38598c85-7c2d-4db6-b313-e424052f46fe None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:34.362721 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:34.365873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:34.428807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b172ea9-9d3c-4429-8874-030856d297bc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:34.465520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cc9a4-b230-4a15-98cb-bcf29f7795fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:34.466442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc9a4-b230-4a15-98cb-bcf29f7795fb None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.466876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc9a4-b230-4a15-98cb-bcf29f7795fb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.467291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc9a4-b230-4a15-98cb-bcf29f7795fb None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a/users/3854e1394dc743bfbab4ce7b02389426/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.469675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cc9a4-b230-4a15-98cb-bcf29f7795fb None admin] RBAC: Authorizing `identity:create_grant(project_id=bd32494f9acf41b2af293e24ff51e99a, user_id=3854e1394dc743bfbab4ce7b02389426, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:34.471256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cc9a4-b230-4a15-98cb-bcf29f7795fb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:34.478277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a74b11-2511-4fcc-9656-bc2211793c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:34.479167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a74b11-2511-4fcc-9656-bc2211793c7e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.479674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a74b11-2511-4fcc-9656-bc2211793c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.480163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a74b11-2511-4fcc-9656-bc2211793c7e None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.485198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a74b11-2511-4fcc-9656-bc2211793c7e None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:34.489228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a74b11-2511-4fcc-9656-bc2211793c7e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:34.490384 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 73/137] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:34 2022] PUT /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a/users/3854e1394dc743bfbab4ce7b02389426/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:34.492396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cc9a4-b230-4a15-98cb-bcf29f7795fb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:34.492988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 65/138] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:34 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:34.498842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a74b11-2511-4fcc-9656-bc2211793c7e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:34.650292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a74b11-2511-4fcc-9656-bc2211793c7e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:34.695010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cc9a4-b230-4a15-98cb-bcf29f7795fb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:34.698511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:34.699614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35ba49-6634-46f4-a0ac-1dc15e8cb79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:34.700712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35ba49-6634-46f4-a0ac-1dc15e8cb79b None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.702017 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35ba49-6634-46f4-a0ac-1dc15e8cb79b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.702445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35ba49-6634-46f4-a0ac-1dc15e8cb79b None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a/users/7641ad2083f64ed5abf305699dc5b1f7/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.711347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35ba49-6634-46f4-a0ac-1dc15e8cb79b None admin] RBAC: Authorizing `identity:create_grant(project_id=bd32494f9acf41b2af293e24ff51e99a, user_id=7641ad2083f64ed5abf305699dc5b1f7, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:34.713060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35ba49-6634-46f4-a0ac-1dc15e8cb79b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:34.738663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 66/139] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:34 2022] PUT /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a/users/7641ad2083f64ed5abf305699dc5b1f7/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:34.757147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add8dd1-e2d8-4e9b-a50e-c8644dabe8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:34.758043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8dd1-e2d8-4e9b-a50e-c8644dabe8bf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.758480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8dd1-e2d8-4e9b-a50e-c8644dabe8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.758891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8dd1-e2d8-4e9b-a50e-c8644dabe8bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.760194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add8dd1-e2d8-4e9b-a50e-c8644dabe8bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:34.761841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add8dd1-e2d8-4e9b-a50e-c8644dabe8bf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:34.764020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 74/140] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:34.773913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35ba49-6634-46f4-a0ac-1dc15e8cb79b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:34.833104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:34.892815 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35ba49-6634-46f4-a0ac-1dc15e8cb79b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:34.930471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3c9d0-eca3-4de1-baf9-042b1698a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:34.931011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c9d0-eca3-4de1-baf9-042b1698a337 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.931290 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c9d0-eca3-4de1-baf9-042b1698a337 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.931563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c9d0-eca3-4de1-baf9-042b1698a337 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.932223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3c9d0-eca3-4de1-baf9-042b1698a337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:34.933723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3c9d0-eca3-4de1-baf9-042b1698a337 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:34.966951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 67/141] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:08:34 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:35.694375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49961d-3a50-4605-bdf8-c578ea60c362 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:35.695351 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49961d-3a50-4605-bdf8-c578ea60c362 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:35.695908 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49961d-3a50-4605-bdf8-c578ea60c362 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:35.697561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 75/142] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:35.703784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b6e80-28ec-4886-8737-38bab4ad3387 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:35.704708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b6e80-28ec-4886-8737-38bab4ad3387 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:35.705199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b6e80-28ec-4886-8737-38bab4ad3387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:35.729663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-215b6e80-28ec-4886-8737-38bab4ad3387 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:35.731737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-215b6e80-28ec-4886-8737-38bab4ad3387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:35.819000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 68/143] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:35.862506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49961d-3a50-4605-bdf8-c578ea60c362 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:35.987912 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49961d-3a50-4605-bdf8-c578ea60c362 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:36.034530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d5f92-6568-4de5-a6dd-d98b3027b862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:36.035560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5f92-6568-4de5-a6dd-d98b3027b862 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.036035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5f92-6568-4de5-a6dd-d98b3027b862 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.036500 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d5f92-6568-4de5-a6dd-d98b3027b862 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.049984 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d5f92-6568-4de5-a6dd-d98b3027b862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a62d5f92-6568-4de5-a6dd-d98b3027b862 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:36.055291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:36.056177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:36.057014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:36.059583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 76/144] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:36.067138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b6e80-28ec-4886-8737-38bab4ad3387 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:36.110435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:36.200561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b6e80-28ec-4886-8737-38bab4ad3387 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:36.245668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0ccbe-36c7-4cba-a359-7018620c5674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:36.246190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0ccbe-36c7-4cba-a359-7018620c5674 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.246468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0ccbe-36c7-4cba-a359-7018620c5674 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.246740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0ccbe-36c7-4cba-a359-7018620c5674 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.247405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0ccbe-36c7-4cba-a359-7018620c5674 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:36.247704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0ccbe-36c7-4cba-a359-7018620c5674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:36.249133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0ccbe-36c7-4cba-a359-7018620c5674 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:36.257778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 69/145] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:36.264992 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d5f92-6568-4de5-a6dd-d98b3027b862 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:36.317498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:36.346375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ebc12-9928-4955-b422-70bbc1549b4b None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.346716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ebc12-9928-4955-b422-70bbc1549b4b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.346929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ebc12-9928-4955-b422-70bbc1549b4b None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.348524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 70/146] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:36.366508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9c4d9-d684-4a6b-8b0b-80f6a0c6c97d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.366816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9c4d9-d684-4a6b-8b0b-80f6a0c6c97d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.367056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9c4d9-d684-4a6b-8b0b-80f6a0c6c97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.409738 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-fbf9c4d9-d684-4a6b-8b0b-80f6a0c6c97d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:36.410933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-fbf9c4d9-d684-4a6b-8b0b-80f6a0c6c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:36.454466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d5f92-6568-4de5-a6dd-d98b3027b862 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:36.515846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 71/147] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:36.530262 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d958fc8-632a-4f2f-be82-b62f80698eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:36.531478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d958fc8-632a-4f2f-be82-b62f80698eef None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.531761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d958fc8-632a-4f2f-be82-b62f80698eef None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.532029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d958fc8-632a-4f2f-be82-b62f80698eef None admin] PATH_INFO: `/v3/users/2d53f52b9a784862b9015d65016259e6` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.537315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d958fc8-632a-4f2f-be82-b62f80698eef None admin] RBAC: Authorizing `identity:get_user(user_id=2d53f52b9a784862b9015d65016259e6)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:36.538770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d958fc8-632a-4f2f-be82-b62f80698eef None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:36.540694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 77/148] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:36 2022] GET /identity/v3/users/2d53f52b9a784862b9015d65016259e6 => generated 289 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:36.546252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9c4d9-d684-4a6b-8b0b-80f6a0c6c97d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:36.566261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d958fc8-632a-4f2f-be82-b62f80698eef None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:36.575241 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:36.682646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9c4d9-d684-4a6b-8b0b-80f6a0c6c97d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:36.730242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942417-2e15-49b9-bafb-19126be83fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:36.730976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942417-2e15-49b9-bafb-19126be83fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.731160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942417-2e15-49b9-bafb-19126be83fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.731417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942417-2e15-49b9-bafb-19126be83fd8 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.737412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c942417-2e15-49b9-bafb-19126be83fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:36.738902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c942417-2e15-49b9-bafb-19126be83fd8 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:36.740793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 72/149] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:36 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:36.746171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942417-2e15-49b9-bafb-19126be83fd8 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:36.785133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:36.791619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d958fc8-632a-4f2f-be82-b62f80698eef None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:36.871860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:36.884237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa279c4-dd67-402b-a63b-ea6a15447e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:36.884914 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa279c4-dd67-402b-a63b-ea6a15447e2c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.885202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa279c4-dd67-402b-a63b-ea6a15447e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.885462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa279c4-dd67-402b-a63b-ea6a15447e2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.889245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942417-2e15-49b9-bafb-19126be83fd8 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:36.910955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa279c4-dd67-402b-a63b-ea6a15447e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-8aa279c4-dd67-402b-a63b-ea6a15447e2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:36.915963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:36.917104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:36.918041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 78/150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:36.918703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27107-09c0-403b-bd85-452af1c03cdd None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.918703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27107-09c0-403b-bd85-452af1c03cdd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.919813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27107-09c0-403b-bd85-452af1c03cdd None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.920452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 79/151] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:36.926769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3a806-6822-44e2-b894-417bea02ba3a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.927042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3a806-6822-44e2-b894-417bea02ba3a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.927316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3a806-6822-44e2-b894-417bea02ba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.949338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156763bc-3140-4651-92ff-1eeb44c9f216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:36.950025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156763bc-3140-4651-92ff-1eeb44c9f216 None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.950310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156763bc-3140-4651-92ff-1eeb44c9f216 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.950577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156763bc-3140-4651-92ff-1eeb44c9f216 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a/users/2d53f52b9a784862b9015d65016259e6/roles/907e76e063c343839d29a28f402e588b` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.952577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156763bc-3140-4651-92ff-1eeb44c9f216 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd32494f9acf41b2af293e24ff51e99a, user_id=2d53f52b9a784862b9015d65016259e6, role_id=907e76e063c343839d29a28f402e588b)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:36.954702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156763bc-3140-4651-92ff-1eeb44c9f216 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:36.957406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-28b3a806-6822-44e2-b894-417bea02ba3a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:36.958617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-28b3a806-6822-44e2-b894-417bea02ba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:36.977568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 73/152] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:36 2022] PUT /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a/users/2d53f52b9a784862b9015d65016259e6/roles/907e76e063c343839d29a28f402e588b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:36.978451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156763bc-3140-4651-92ff-1eeb44c9f216 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.110876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 80/153] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:37.168104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3a806-6822-44e2-b894-417bea02ba3a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.178643 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156763bc-3140-4651-92ff-1eeb44c9f216 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.235379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560acb1-41c0-4e24-8758-58428874c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.236000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560acb1-41c0-4e24-8758-58428874c3de None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.236272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560acb1-41c0-4e24-8758-58428874c3de None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.236536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560acb1-41c0-4e24-8758-58428874c3de None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.237247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560acb1-41c0-4e24-8758-58428874c3de None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:37.237546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560acb1-41c0-4e24-8758-58428874c3de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:37.238956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560acb1-41c0-4e24-8758-58428874c3de None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:37.255883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 74/154] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:37.262696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560acb1-41c0-4e24-8758-58428874c3de None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.292250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:37.366829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:37.404735 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3a806-6822-44e2-b894-417bea02ba3a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.494485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1429c-2c59-49bc-ab05-306d557e9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.495139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1429c-2c59-49bc-ab05-306d557e9bdf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.495432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1429c-2c59-49bc-ab05-306d557e9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.495867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1429c-2c59-49bc-ab05-306d557e9bdf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.517468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560acb1-41c0-4e24-8758-58428874c3de None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.520872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1429c-2c59-49bc-ab05-306d557e9bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-61c1429c-2c59-49bc-ab05-306d557e9bdf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:37.526130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:37.526995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:37.527940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 81/155] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:08:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:37.533501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1429c-2c59-49bc-ab05-306d557e9bdf None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.614265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfc65a-3d84-4b93-8b17-ced2172e29e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.614917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfc65a-3d84-4b93-8b17-ced2172e29e6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.615197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfc65a-3d84-4b93-8b17-ced2172e29e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.615470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfc65a-3d84-4b93-8b17-ced2172e29e6 None admin] PATH_INFO: `/v3/users/7641ad2083f64ed5abf305699dc5b1f7` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.621435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfc65a-3d84-4b93-8b17-ced2172e29e6 None admin] RBAC: Authorizing `identity:get_user(user_id=7641ad2083f64ed5abf305699dc5b1f7)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:37.622848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfc65a-3d84-4b93-8b17-ced2172e29e6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:37.625058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 75/156] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:37 2022] GET /identity/v3/users/7641ad2083f64ed5abf305699dc5b1f7 => generated 275 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:37.631071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfc65a-3d84-4b93-8b17-ced2172e29e6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.758132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1429c-2c59-49bc-ab05-306d557e9bdf None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.839642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f174-246a-42ee-943b-cb9f5e34b1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.840298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f174-246a-42ee-943b-cb9f5e34b1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.840538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f174-246a-42ee-943b-cb9f5e34b1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.840812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f174-246a-42ee-943b-cb9f5e34b1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.841260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:37.841624 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89f174-246a-42ee-943b-cb9f5e34b1c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:37.841783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89f174-246a-42ee-943b-cb9f5e34b1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:37.843151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89f174-246a-42ee-943b-cb9f5e34b1c4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:37.857151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 82/157] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:08:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:37.864110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f174-246a-42ee-943b-cb9f5e34b1c4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.889096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:37.918619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfc65a-3d84-4b93-8b17-ced2172e29e6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.985569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c907b-04f6-4379-830d-ee56fd9d8090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.986193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c907b-04f6-4379-830d-ee56fd9d8090 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.986475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c907b-04f6-4379-830d-ee56fd9d8090 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.986750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c907b-04f6-4379-830d-ee56fd9d8090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:38.041609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f174-246a-42ee-943b-cb9f5e34b1c4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:38.111034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c907b-04f6-4379-830d-ee56fd9d8090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:38.112555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c907b-04f6-4379-830d-ee56fd9d8090 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:38.113960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab91c91-f517-453c-92c8-5bed20710078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:38.114727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab91c91-f517-453c-92c8-5bed20710078 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:38.115012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab91c91-f517-453c-92c8-5bed20710078 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:38.115311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab91c91-f517-453c-92c8-5bed20710078 None admin] PATH_INFO: `/v3/users/7641ad2083f64ed5abf305699dc5b1f7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:38.116606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab91c91-f517-453c-92c8-5bed20710078 None admin] RBAC: Authorizing `identity:get_user(user_id=7641ad2083f64ed5abf305699dc5b1f7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:38.118114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab91c91-f517-453c-92c8-5bed20710078 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:38.119858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 83/158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:37 2022] GET /identity/v3/users/7641ad2083f64ed5abf305699dc5b1f7 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:38.133791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab91c91-f517-453c-92c8-5bed20710078 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:38.246460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:38.278137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:38.289610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 76/159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:08:38.291170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa0cf-1c08-48cb-bc41-ecffeb75748e None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:38.291673 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa0cf-1c08-48cb-bc41-ecffeb75748e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:38.292192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa0cf-1c08-48cb-bc41-ecffeb75748e None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:38.293819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 77/160] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:38.298274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aa0cf-1c08-48cb-bc41-ecffeb75748e None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:38.329716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab91c91-f517-453c-92c8-5bed20710078 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:38.395068 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd437c-09c9-4585-9cbf-e6c55fe73523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:38.396049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd437c-09c9-4585-9cbf-e6c55fe73523 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:38.396728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd437c-09c9-4585-9cbf-e6c55fe73523 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:38.397936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd437c-09c9-4585-9cbf-e6c55fe73523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:38.522289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aa0cf-1c08-48cb-bc41-ecffeb75748e None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:38.563976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd437c-09c9-4585-9cbf-e6c55fe73523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:38.568193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd437c-09c9-4585-9cbf-e6c55fe73523 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:38.604899 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2cb1c-8eb2-4484-a69e-4ef5bd793d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:38.605537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2cb1c-8eb2-4484-a69e-4ef5bd793d1b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:38.605813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2cb1c-8eb2-4484-a69e-4ef5bd793d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:38.606082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2cb1c-8eb2-4484-a69e-4ef5bd793d1b None admin] PATH_INFO: `/v3/projects/c710bb205c7a46e899a86be8e75a85d8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:38.607359 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2cb1c-8eb2-4484-a69e-4ef5bd793d1b None admin] RBAC: Authorizing `identity:get_project(project_id=c710bb205c7a46e899a86be8e75a85d8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:38.608848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2cb1c-8eb2-4484-a69e-4ef5bd793d1b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:38.610759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 78/161] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:38 2022] GET /identity/v3/projects/c710bb205c7a46e899a86be8e75a85d8 => generated 312 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:38.611688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7d24b-cd54-43b9-9175-20def2bf23ce None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:38.611963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7d24b-cd54-43b9-9175-20def2bf23ce None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:38.612303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7d24b-cd54-43b9-9175-20def2bf23ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:38.660549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-25e7d24b-cd54-43b9-9175-20def2bf23ce None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:38.663106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-25e7d24b-cd54-43b9-9175-20def2bf23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:38.714803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:38.747721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:38.755957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 84/162] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:08:38.756955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd437c-09c9-4585-9cbf-e6c55fe73523 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:38.801166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 79/163] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:38.802292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce65f-4bcb-48e7-aee7-6e1f5c5a848f None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:38.802580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce65f-4bcb-48e7-aee7-6e1f5c5a848f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:38.802851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce65f-4bcb-48e7-aee7-6e1f5c5a848f None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:38.804341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 80/164] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:38.804945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ce65f-4bcb-48e7-aee7-6e1f5c5a848f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:38.931666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd437c-09c9-4585-9cbf-e6c55fe73523 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:39.022400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ce65f-4bcb-48e7-aee7-6e1f5c5a848f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:39.035427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9780de-9361-484b-9ccb-07aa789b4c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:39.036048 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9780de-9361-484b-9ccb-07aa789b4c15 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:39.036323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9780de-9361-484b-9ccb-07aa789b4c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:39.036585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9780de-9361-484b-9ccb-07aa789b4c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:39.037335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9780de-9361-484b-9ccb-07aa789b4c15 None admin] RBAC: Adding query filter params (role.id=12dc9c7d75da4722bf4525a56eea0e47, scope.project.id=c710bb205c7a46e899a86be8e75a85d8, user.id=7641ad2083f64ed5abf305699dc5b1f7) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:39.037633 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9780de-9361-484b-9ccb-07aa789b4c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:39.039084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9780de-9361-484b-9ccb-07aa789b4c15 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:39.056263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 85/165] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:38 2022] GET /identity/v3/role_assignments?user.id=7641ad2083f64ed5abf305699dc5b1f7&scope.project.id=c710bb205c7a46e899a86be8e75a85d8&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:39.057489 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79232913-4feb-4294-9002-589a7adf70fe None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:39.057728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79232913-4feb-4294-9002-589a7adf70fe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:39.057995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79232913-4feb-4294-9002-589a7adf70fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:39.108217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-79232913-4feb-4294-9002-589a7adf70fe None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:39.109588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-79232913-4feb-4294-9002-589a7adf70fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:39.122327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db613759-ebbd-4fb0-9496-4bfc156dc97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:39.122971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db613759-ebbd-4fb0-9496-4bfc156dc97f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:39.123249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db613759-ebbd-4fb0-9496-4bfc156dc97f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:39.123517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db613759-ebbd-4fb0-9496-4bfc156dc97f None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:39.125272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db613759-ebbd-4fb0-9496-4bfc156dc97f None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:39.126916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db613759-ebbd-4fb0-9496-4bfc156dc97f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:39.128657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 81/166] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:38 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:39.129410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db613759-ebbd-4fb0-9496-4bfc156dc97f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:39.199174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:39.240658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:39.266622 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 86/167] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:39.267330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79232913-4feb-4294-9002-589a7adf70fe None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:39.354598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db613759-ebbd-4fb0-9496-4bfc156dc97f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:39.428922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a4ece-e79e-4c43-93c8-601e3882a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:39.429562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a4ece-e79e-4c43-93c8-601e3882a3fe None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:39.429838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a4ece-e79e-4c43-93c8-601e3882a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:39.430108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a4ece-e79e-4c43-93c8-601e3882a3fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:39.448081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a4ece-e79e-4c43-93c8-601e3882a3fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-460a4ece-e79e-4c43-93c8-601e3882a3fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:39.459329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:39.460475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 82/168] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:39.461339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a4ece-e79e-4c43-93c8-601e3882a3fe None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:39.480834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79232913-4feb-4294-9002-589a7adf70fe None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:39.553364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b532f4-7486-4fe2-aedf-b4183ef9e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:39.553976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b532f4-7486-4fe2-aedf-b4183ef9e48c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:39.554251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b532f4-7486-4fe2-aedf-b4183ef9e48c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:39.554518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b532f4-7486-4fe2-aedf-b4183ef9e48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:39.555244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b532f4-7486-4fe2-aedf-b4183ef9e48c None admin] RBAC: Adding query filter params (role.id=c6822f728eca477f81827dcc4c547bd0, scope.project.id=bd32494f9acf41b2af293e24ff51e99a, user.id=7641ad2083f64ed5abf305699dc5b1f7) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:39.555547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b532f4-7486-4fe2-aedf-b4183ef9e48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:39.557006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b532f4-7486-4fe2-aedf-b4183ef9e48c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:39.569186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 87/169] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:39 2022] GET /identity/v3/role_assignments?user.id=7641ad2083f64ed5abf305699dc5b1f7&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=c6822f728eca477f81827dcc4c547bd0 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:39.570013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b532f4-7486-4fe2-aedf-b4183ef9e48c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:39.672926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:39.708958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a4ece-e79e-4c43-93c8-601e3882a3fe None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:39.716031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:39.794299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f4c6c-5fe5-4445-892d-bdb4852bf5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:39.794954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f4c6c-5fe5-4445-892d-bdb4852bf5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:39.795229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f4c6c-5fe5-4445-892d-bdb4852bf5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:39.795498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f4c6c-5fe5-4445-892d-bdb4852bf5b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:39.799677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b532f4-7486-4fe2-aedf-b4183ef9e48c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:39.819587 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f4c6c-5fe5-4445-892d-bdb4852bf5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-bb9f4c6c-5fe5-4445-892d-bdb4852bf5b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:39.824427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:39.825365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:39.826128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 83/170] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:39.831684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f4c6c-5fe5-4445-892d-bdb4852bf5b9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:39.844726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e743429-8982-48ef-9db3-96da3cf0e286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:39.845345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e743429-8982-48ef-9db3-96da3cf0e286 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:39.845617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e743429-8982-48ef-9db3-96da3cf0e286 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:39.845887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e743429-8982-48ef-9db3-96da3cf0e286 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:39.846562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e743429-8982-48ef-9db3-96da3cf0e286 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:39.846861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e743429-8982-48ef-9db3-96da3cf0e286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:39.848244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e743429-8982-48ef-9db3-96da3cf0e286 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:39.862511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 88/171] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:39.868981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e743429-8982-48ef-9db3-96da3cf0e286 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:39.994286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:39.998885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e743429-8982-48ef-9db3-96da3cf0e286 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.025039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f4c6c-5fe5-4445-892d-bdb4852bf5b9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.040068 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f319d-3679-4409-be97-9c3507a425ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.040812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f319d-3679-4409-be97-9c3507a425ad None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.041093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f319d-3679-4409-be97-9c3507a425ad None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.041364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f319d-3679-4409-be97-9c3507a425ad None admin] PATH_INFO: `/v3/users/3854e1394dc743bfbab4ce7b02389426` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.042510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f319d-3679-4409-be97-9c3507a425ad None admin] RBAC: Authorizing `identity:get_user(user_id=3854e1394dc743bfbab4ce7b02389426)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:40.043952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f319d-3679-4409-be97-9c3507a425ad None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:40.049121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 89/172] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:39 2022] GET /identity/v3/users/3854e1394dc743bfbab4ce7b02389426 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:40.049121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2dd7a-802d-44c1-8cb9-9d30f4703d4c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.049121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2dd7a-802d-44c1-8cb9-9d30f4703d4c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.049121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2dd7a-802d-44c1-8cb9-9d30f4703d4c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.049121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 90/173] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:40.055939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2dd7a-802d-44c1-8cb9-9d30f4703d4c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.082750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5794055-fe1b-41e8-a713-08e7ee9378b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.083377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794055-fe1b-41e8-a713-08e7ee9378b1 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.083657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794055-fe1b-41e8-a713-08e7ee9378b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.083929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794055-fe1b-41e8-a713-08e7ee9378b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.084604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5794055-fe1b-41e8-a713-08e7ee9378b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:40.084995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5794055-fe1b-41e8-a713-08e7ee9378b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:40.086406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5794055-fe1b-41e8-a713-08e7ee9378b1 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:40.096091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 84/174] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:40.097148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ba5f-6757-4584-b67d-fb99baca8185 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.097436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ba5f-6757-4584-b67d-fb99baca8185 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.097709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ba5f-6757-4584-b67d-fb99baca8185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.132861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-2a15ba5f-6757-4584-b67d-fb99baca8185 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:40.134085 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2a15ba5f-6757-4584-b67d-fb99baca8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:40.168760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2dd7a-802d-44c1-8cb9-9d30f4703d4c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.169091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.206676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e184c-4243-4a40-ba3a-1d72d511a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.207556 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e184c-4243-4a40-ba3a-1d72d511a92b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.208003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e184c-4243-4a40-ba3a-1d72d511a92b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.208411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e184c-4243-4a40-ba3a-1d72d511a92b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.224537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 85/175] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:40.225538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15ba5f-6757-4584-b67d-fb99baca8185 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.246565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.287760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e184c-4243-4a40-ba3a-1d72d511a92b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:40.289270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e184c-4243-4a40-ba3a-1d72d511a92b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:40.338965 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15ba5f-6757-4584-b67d-fb99baca8185 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.377447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460718a-520d-45ba-b772-98c2c6078fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.378429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460718a-520d-45ba-b772-98c2c6078fbd None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.378915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460718a-520d-45ba-b772-98c2c6078fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.379337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460718a-520d-45ba-b772-98c2c6078fbd None admin] PATH_INFO: `/v3/users/7641ad2083f64ed5abf305699dc5b1f7` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.380638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460718a-520d-45ba-b772-98c2c6078fbd None admin] RBAC: Authorizing `identity:get_user(user_id=7641ad2083f64ed5abf305699dc5b1f7)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:40.382380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460718a-520d-45ba-b772-98c2c6078fbd None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:40.384117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 86/176] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/users/7641ad2083f64ed5abf305699dc5b1f7 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:40.385675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a61b33-5f47-4491-a5e0-0c278baf4859 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.386095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a61b33-5f47-4491-a5e0-0c278baf4859 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.386504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a61b33-5f47-4491-a5e0-0c278baf4859 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.387972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 87/177] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:40.393418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a61b33-5f47-4491-a5e0-0c278baf4859 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.395594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 91/178] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:08:40.396404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e184c-4243-4a40-ba3a-1d72d511a92b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.431817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.464137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.498719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e184c-4243-4a40-ba3a-1d72d511a92b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.517602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a61b33-5f47-4491-a5e0-0c278baf4859 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.532780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9649f0-a55e-41a5-8130-7bea80f28eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.533391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9649f0-a55e-41a5-8130-7bea80f28eba None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.533662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9649f0-a55e-41a5-8130-7bea80f28eba None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.533931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9649f0-a55e-41a5-8130-7bea80f28eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.554166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6b9c5-4b15-4f4c-807a-349b420bb033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.554800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b9c5-4b15-4f4c-807a-349b420bb033 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.555076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b9c5-4b15-4f4c-807a-349b420bb033 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.555342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b9c5-4b15-4f4c-807a-349b420bb033 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.566850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6b9c5-4b15-4f4c-807a-349b420bb033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-eae6b9c5-4b15-4f4c-807a-349b420bb033 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:40.571556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:40.572456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:40.573278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 88/179] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:40.573923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4e4c-a5bc-4a78-8d66-cd5461a74c0d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.575584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4e4c-a5bc-4a78-8d66-cd5461a74c0d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.575584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4e4c-a5bc-4a78-8d66-cd5461a74c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.593109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4ccf4e4c-a5bc-4a78-8d66-cd5461a74c0d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:40.594332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4ccf4e4c-a5bc-4a78-8d66-cd5461a74c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:40.610127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9649f0-a55e-41a5-8130-7bea80f28eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:40.611594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9649f0-a55e-41a5-8130-7bea80f28eba None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:40.661684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 89/180] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:40.672840 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4e4c-a5bc-4a78-8d66-cd5461a74c0d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.676511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.679302 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.712898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 92/181] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:40.714255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200783b3-270e-4a3e-8518-284c8f2ac44c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.714536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200783b3-270e-4a3e-8518-284c8f2ac44c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.714801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200783b3-270e-4a3e-8518-284c8f2ac44c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.716037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 93/182] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:40.717513 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200783b3-270e-4a3e-8518-284c8f2ac44c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.771954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4e4c-a5bc-4a78-8d66-cd5461a74c0d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.805536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34dec3-48af-4937-a764-ec6251289790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.806158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34dec3-48af-4937-a764-ec6251289790 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.806430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34dec3-48af-4937-a764-ec6251289790 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.806700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34dec3-48af-4937-a764-ec6251289790 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.807805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34dec3-48af-4937-a764-ec6251289790 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:40.809279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34dec3-48af-4937-a764-ec6251289790 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:40.810878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 90/183] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:40.812151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2b0fd-fa58-451d-a610-1acbb143ff1a None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.812952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2b0fd-fa58-451d-a610-1acbb143ff1a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.813216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2b0fd-fa58-451d-a610-1acbb143ff1a None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.814425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 91/184] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:40.815102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2b0fd-fa58-451d-a610-1acbb143ff1a None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.822396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200783b3-270e-4a3e-8518-284c8f2ac44c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.856835 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c510bfd-358d-4d05-a7b7-b477614d1910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.857425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c510bfd-358d-4d05-a7b7-b477614d1910 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.857699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c510bfd-358d-4d05-a7b7-b477614d1910 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.857965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c510bfd-358d-4d05-a7b7-b477614d1910 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.858619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c510bfd-358d-4d05-a7b7-b477614d1910 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:40.858973 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c510bfd-358d-4d05-a7b7-b477614d1910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:40.860327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c510bfd-358d-4d05-a7b7-b477614d1910 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:40.868084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 94/185] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:40.868950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c510bfd-358d-4d05-a7b7-b477614d1910 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.895931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.902611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.922618 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2b0fd-fa58-451d-a610-1acbb143ff1a None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.956390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0990f-9e05-4907-b4b1-e4c1d74c91a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.957037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0990f-9e05-4907-b4b1-e4c1d74c91a0 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.957319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0990f-9e05-4907-b4b1-e4c1d74c91a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.957584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0990f-9e05-4907-b4b1-e4c1d74c91a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.966080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c510bfd-358d-4d05-a7b7-b477614d1910 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.968121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0990f-9e05-4907-b4b1-e4c1d74c91a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-81c0990f-9e05-4907-b4b1-e4c1d74c91a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:40.973680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:40.974732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:40.975517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 92/186] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:40.976172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96199847-87b5-460d-922b-228a602e9cd0 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.976237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96199847-87b5-460d-922b-228a602e9cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.976724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96199847-87b5-460d-922b-228a602e9cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.994273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-96199847-87b5-460d-922b-228a602e9cd0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:40.995457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-96199847-87b5-460d-922b-228a602e9cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:41.004672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299ed34-852e-4e73-9fe5-ec4c24979aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.005299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ed34-852e-4e73-9fe5-ec4c24979aac None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.005567 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ed34-852e-4e73-9fe5-ec4c24979aac None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.005829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ed34-852e-4e73-9fe5-ec4c24979aac None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.006933 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299ed34-852e-4e73-9fe5-ec4c24979aac None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.008356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299ed34-852e-4e73-9fe5-ec4c24979aac None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.010016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 95/187] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.010749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299ed34-852e-4e73-9fe5-ec4c24979aac None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.063682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 93/188] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:41.064877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8376e-cb72-4448-96ca-d7a7eabc46fc None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.065162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8376e-cb72-4448-96ca-d7a7eabc46fc None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.065441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8376e-cb72-4448-96ca-d7a7eabc46fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.082402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d4b8376e-cb72-4448-96ca-d7a7eabc46fc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:41.083576 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d4b8376e-cb72-4448-96ca-d7a7eabc46fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:41.106032 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.113430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299ed34-852e-4e73-9fe5-ec4c24979aac None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.153433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 94/189] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:41.157917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a22cf-bacf-43b7-8857-bbe7789bc243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.158055 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8376e-cb72-4448-96ca-d7a7eabc46fc None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.158145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a22cf-bacf-43b7-8857-bbe7789bc243 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.159919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a22cf-bacf-43b7-8857-bbe7789bc243 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.159919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a22cf-bacf-43b7-8857-bbe7789bc243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.159919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a22cf-bacf-43b7-8857-bbe7789bc243 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=bd32494f9acf41b2af293e24ff51e99a, user.id=3854e1394dc743bfbab4ce7b02389426) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:41.159919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a22cf-bacf-43b7-8857-bbe7789bc243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.162349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a22cf-bacf-43b7-8857-bbe7789bc243 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.180652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 96/190] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/role_assignments?user.id=3854e1394dc743bfbab4ce7b02389426&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=d6155b01aace49f887f29aa2861d31cf => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.180652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a22cf-bacf-43b7-8857-bbe7789bc243 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.180945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.292655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8376e-cb72-4448-96ca-d7a7eabc46fc None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.317063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a22cf-bacf-43b7-8857-bbe7789bc243 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.341265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97fc67-3f3c-40ad-9a1c-61fa66adbb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.341265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97fc67-3f3c-40ad-9a1c-61fa66adbb45 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.341265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97fc67-3f3c-40ad-9a1c-61fa66adbb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.341265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97fc67-3f3c-40ad-9a1c-61fa66adbb45 None admin] PATH_INFO: `/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.359062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97fc67-3f3c-40ad-9a1c-61fa66adbb45 None admin] RBAC: Authorizing `identity:get_user(user_id=2e24a9a4863b4b21a3a292fca9a07e6c)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.360552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97fc67-3f3c-40ad-9a1c-61fa66adbb45 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.362519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 95/191] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.363048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97fc67-3f3c-40ad-9a1c-61fa66adbb45 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.367423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92061-d861-4765-9558-d56214686e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.368058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92061-d861-4765-9558-d56214686e89 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.368331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92061-d861-4765-9558-d56214686e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.368593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92061-d861-4765-9558-d56214686e89 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.369299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c92061-d861-4765-9558-d56214686e89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:41.369595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c92061-d861-4765-9558-d56214686e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.371026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c92061-d861-4765-9558-d56214686e89 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.382183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 97/192] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.383676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92061-d861-4765-9558-d56214686e89 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.422178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.444278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.497582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97fc67-3f3c-40ad-9a1c-61fa66adbb45 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.509558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92061-d861-4765-9558-d56214686e89 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.533111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d10789-1a4b-4c33-bdca-74261a3fdba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.533711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d10789-1a4b-4c33-bdca-74261a3fdba4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.533983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d10789-1a4b-4c33-bdca-74261a3fdba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.534254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d10789-1a4b-4c33-bdca-74261a3fdba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.534972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d10789-1a4b-4c33-bdca-74261a3fdba4 None admin] RBAC: Adding query filter params (role.id=12dc9c7d75da4722bf4525a56eea0e47, scope.project.id=bd32494f9acf41b2af293e24ff51e99a, user.id=7641ad2083f64ed5abf305699dc5b1f7) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:41.535274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d10789-1a4b-4c33-bdca-74261a3fdba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.536754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d10789-1a4b-4c33-bdca-74261a3fdba4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.542408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 96/193] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/role_assignments?user.id=7641ad2083f64ed5abf305699dc5b1f7&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.543187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d10789-1a4b-4c33-bdca-74261a3fdba4 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.543384 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ba6b2-2ddf-4481-bd9a-2018d22781ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.544047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ba6b2-2ddf-4481-bd9a-2018d22781ec None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.544324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ba6b2-2ddf-4481-bd9a-2018d22781ec None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.544588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ba6b2-2ddf-4481-bd9a-2018d22781ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.557856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ba6b2-2ddf-4481-bd9a-2018d22781ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-4f0ba6b2-2ddf-4481-bd9a-2018d22781ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:41.566301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:41.567304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:41.568113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 98/194] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:41.568827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ba6b2-2ddf-4481-bd9a-2018d22781ec None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.657745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d10789-1a4b-4c33-bdca-74261a3fdba4 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.670988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.684897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.694392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ba6b2-2ddf-4481-bd9a-2018d22781ec None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.701515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80182b81-2e57-4658-b00c-cca321a77907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.702266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80182b81-2e57-4658-b00c-cca321a77907 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.702549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80182b81-2e57-4658-b00c-cca321a77907 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.703167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80182b81-2e57-4658-b00c-cca321a77907 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.704482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80182b81-2e57-4658-b00c-cca321a77907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.706525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80182b81-2e57-4658-b00c-cca321a77907 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.708736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 97/195] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.708736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80182b81-2e57-4658-b00c-cca321a77907 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.744914 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332f3ae-ce45-400d-81e3-e4a7e6ed01cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.745372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332f3ae-ce45-400d-81e3-e4a7e6ed01cc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.745678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332f3ae-ce45-400d-81e3-e4a7e6ed01cc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.745948 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332f3ae-ce45-400d-81e3-e4a7e6ed01cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.819875 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332f3ae-ce45-400d-81e3-e4a7e6ed01cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.821274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332f3ae-ce45-400d-81e3-e4a7e6ed01cc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.822025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80182b81-2e57-4658-b00c-cca321a77907 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.855239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1726cd0-34eb-454b-9dad-eeb6c682cd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.855859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726cd0-34eb-454b-9dad-eeb6c682cd8d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.856139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726cd0-34eb-454b-9dad-eeb6c682cd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.856409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726cd0-34eb-454b-9dad-eeb6c682cd8d None admin] PATH_INFO: `/v3/users/2d53f52b9a784862b9015d65016259e6` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.857559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1726cd0-34eb-454b-9dad-eeb6c682cd8d None admin] RBAC: Authorizing `identity:get_user(user_id=2d53f52b9a784862b9015d65016259e6)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.859561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1726cd0-34eb-454b-9dad-eeb6c682cd8d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.861318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 98/196] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/users/2d53f52b9a784862b9015d65016259e6 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.866231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1726cd0-34eb-454b-9dad-eeb6c682cd8d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.899368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.919135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 99/197] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:41.919936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332f3ae-ce45-400d-81e3-e4a7e6ed01cc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.927187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.966646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1726cd0-34eb-454b-9dad-eeb6c682cd8d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.000671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb0f24-deae-4137-b14a-056e4409b8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.001279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb0f24-deae-4137-b14a-056e4409b8ca None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.001559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb0f24-deae-4137-b14a-056e4409b8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.001832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb0f24-deae-4137-b14a-056e4409b8ca None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.002484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb0f24-deae-4137-b14a-056e4409b8ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:42.002786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb0f24-deae-4137-b14a-056e4409b8ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.004151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb0f24-deae-4137-b14a-056e4409b8ca None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.011942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 99/198] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:42.012747 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb0f24-deae-4137-b14a-056e4409b8ca None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:42.019313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332f3ae-ce45-400d-81e3-e4a7e6ed01cc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.054244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4fab-d28a-400a-b9ca-68185335154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.054844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4fab-d28a-400a-b9ca-68185335154f None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.055149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4fab-d28a-400a-b9ca-68185335154f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.055430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4fab-d28a-400a-b9ca-68185335154f None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.056068 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4fab-d28a-400a-b9ca-68185335154f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.057557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4fab-d28a-400a-b9ca-68185335154f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.088825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 100/199] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:08:41 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:42.088825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4fab-d28a-400a-b9ca-68185335154f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:42.126391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:42.127669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb0f24-deae-4137-b14a-056e4409b8ca None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.153822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:42.169612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79e5b7-ce75-4afe-98f9-6b47dc075c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.170234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79e5b7-ce75-4afe-98f9-6b47dc075c82 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.170512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79e5b7-ce75-4afe-98f9-6b47dc075c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.170776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79e5b7-ce75-4afe-98f9-6b47dc075c82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.198714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4fab-d28a-400a-b9ca-68185335154f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.237309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133879f-a32f-4a98-9780-52b67c40252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.237309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133879f-a32f-4a98-9780-52b67c40252f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.237607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133879f-a32f-4a98-9780-52b67c40252f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.237876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133879f-a32f-4a98-9780-52b67c40252f None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.239016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133879f-a32f-4a98-9780-52b67c40252f None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.240459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133879f-a32f-4a98-9780-52b67c40252f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.242142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 101/200] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:42 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:42.242890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133879f-a32f-4a98-9780-52b67c40252f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:42.250116 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79e5b7-ce75-4afe-98f9-6b47dc075c82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.251591 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79e5b7-ce75-4afe-98f9-6b47dc075c82 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.373305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133879f-a32f-4a98-9780-52b67c40252f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.380867 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 100/201] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:42.381203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:42.382206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79e5b7-ce75-4afe-98f9-6b47dc075c82 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:42.413905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:42.425864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e3d5e-d2f9-4a70-bb4a-18295bd5594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.426807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e3d5e-d2f9-4a70-bb4a-18295bd5594b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.427282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e3d5e-d2f9-4a70-bb4a-18295bd5594b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.427764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e3d5e-d2f9-4a70-bb4a-18295bd5594b None admin] PATH_INFO: `/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.429648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e3d5e-d2f9-4a70-bb4a-18295bd5594b None admin] RBAC: Authorizing `identity:get_user(user_id=2e24a9a4863b4b21a3a292fca9a07e6c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.431223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e3d5e-d2f9-4a70-bb4a-18295bd5594b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.436658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 102/202] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:42 2022] GET /identity/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:42.436658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e3d5e-d2f9-4a70-bb4a-18295bd5594b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:42.525927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79e5b7-ce75-4afe-98f9-6b47dc075c82 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.573272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d14f3-f07e-4253-8d06-3083085bb7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.574026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d14f3-f07e-4253-8d06-3083085bb7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.574311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d14f3-f07e-4253-8d06-3083085bb7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.574412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e3d5e-d2f9-4a70-bb4a-18295bd5594b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.574585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d14f3-f07e-4253-8d06-3083085bb7a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.575319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d14f3-f07e-4253-8d06-3083085bb7a4 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=fe25744415024ccba84b98723af57001, user.id=2e24a9a4863b4b21a3a292fca9a07e6c) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:42.576022 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d14f3-f07e-4253-8d06-3083085bb7a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.577587 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d14f3-f07e-4253-8d06-3083085bb7a4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.583965 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 101/203] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:42 2022] GET /identity/v3/role_assignments?user.id=2e24a9a4863b4b21a3a292fca9a07e6c&scope.project.id=fe25744415024ccba84b98723af57001&role.id=d6155b01aace49f887f29aa2861d31cf => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:42.584849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d14f3-f07e-4253-8d06-3083085bb7a4 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:42.633790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb45194-c69e-4a45-8de6-a9e7f3975c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.634604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb45194-c69e-4a45-8de6-a9e7f3975c39 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.634887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb45194-c69e-4a45-8de6-a9e7f3975c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.635283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb45194-c69e-4a45-8de6-a9e7f3975c39 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.639891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb45194-c69e-4a45-8de6-a9e7f3975c39 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.642006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb45194-c69e-4a45-8de6-a9e7f3975c39 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.649277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 103/204] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:42 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:42.657627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb45194-c69e-4a45-8de6-a9e7f3975c39 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:42.755609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:42.776312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:42.805032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d14f3-f07e-4253-8d06-3083085bb7a4 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.858692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb45194-c69e-4a45-8de6-a9e7f3975c39 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.877131 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db2e58-dd81-483d-b37d-56bfc8d755c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.878095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db2e58-dd81-483d-b37d-56bfc8d755c4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.878568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db2e58-dd81-483d-b37d-56bfc8d755c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.879036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db2e58-dd81-483d-b37d-56bfc8d755c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.933159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183c9e7-f074-4211-8fed-25db67f96397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.934271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183c9e7-f074-4211-8fed-25db67f96397 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.934746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183c9e7-f074-4211-8fed-25db67f96397 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.935211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183c9e7-f074-4211-8fed-25db67f96397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.936214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183c9e7-f074-4211-8fed-25db67f96397 None admin] RBAC: Adding query filter params (role.id=907e76e063c343839d29a28f402e588b, scope.project.id=bd32494f9acf41b2af293e24ff51e99a, user.id=2d53f52b9a784862b9015d65016259e6) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:42.936806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183c9e7-f074-4211-8fed-25db67f96397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.939539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183c9e7-f074-4211-8fed-25db67f96397 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.947611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 104/205] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:42 2022] GET /identity/v3/role_assignments?user.id=2d53f52b9a784862b9015d65016259e6&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=907e76e063c343839d29a28f402e588b => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:43.008273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db2e58-dd81-483d-b37d-56bfc8d755c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:43.009827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db2e58-dd81-483d-b37d-56bfc8d755c4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:43.121893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:43.149825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 102/206] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:43.156341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183c9e7-f074-4211-8fed-25db67f96397 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:43.284678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183c9e7-f074-4211-8fed-25db67f96397 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:43.291954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:43.320292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be7e91-b9fe-477c-ac63-d89904bbed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:43.321316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be7e91-b9fe-477c-ac63-d89904bbed6f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:43.321794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be7e91-b9fe-477c-ac63-d89904bbed6f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:43.322262 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be7e91-b9fe-477c-ac63-d89904bbed6f None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:43.323577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be7e91-b9fe-477c-ac63-d89904bbed6f None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:43.325285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be7e91-b9fe-477c-ac63-d89904bbed6f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:43.328125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 105/207] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:43 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:43.334222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db2e58-dd81-483d-b37d-56bfc8d755c4 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:43.458640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db2e58-dd81-483d-b37d-56bfc8d755c4 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:43.500883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2e41a-02d7-480a-ae16-8a1aba9ce960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:43.501931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2e41a-02d7-480a-ae16-8a1aba9ce960 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:43.502408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2e41a-02d7-480a-ae16-8a1aba9ce960 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:43.502895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2e41a-02d7-480a-ae16-8a1aba9ce960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:43.503891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2e41a-02d7-480a-ae16-8a1aba9ce960 None admin] RBAC: Adding query filter params (role.id=c6822f728eca477f81827dcc4c547bd0, scope.project.id=fe25744415024ccba84b98723af57001, user.id=2e24a9a4863b4b21a3a292fca9a07e6c) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:43.504446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2e41a-02d7-480a-ae16-8a1aba9ce960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:43.506135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2e41a-02d7-480a-ae16-8a1aba9ce960 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:43.513048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 103/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:43 2022] GET /identity/v3/role_assignments?user.id=2e24a9a4863b4b21a3a292fca9a07e6c&scope.project.id=fe25744415024ccba84b98723af57001&role.id=c6822f728eca477f81827dcc4c547bd0 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:44.474890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae2eaa-2b47-4f1c-b279-0466a42588ef None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.475392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae2eaa-2b47-4f1c-b279-0466a42588ef None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.475503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae2eaa-2b47-4f1c-b279-0466a42588ef None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.477079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 106/209] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:44.482204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4681d3-cb66-408d-b288-bf035eb620f9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.482584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4681d3-cb66-408d-b288-bf035eb620f9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.482755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4681d3-cb66-408d-b288-bf035eb620f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.501781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4c4681d3-cb66-408d-b288-bf035eb620f9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:44.502971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4c4681d3-cb66-408d-b288-bf035eb620f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:44.507216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9ba1-d323-4d04-afb0-ca21aea67087 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.507498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9ba1-d323-4d04-afb0-ca21aea67087 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.507764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9ba1-d323-4d04-afb0-ca21aea67087 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.509124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 107/210] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:44.514131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6341-c1f7-41fb-82e5-3f95babb661b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.514408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6341-c1f7-41fb-82e5-3f95babb661b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.514677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6341-c1f7-41fb-82e5-3f95babb661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.533749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-00dd6341-c1f7-41fb-82e5-3f95babb661b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:44.534900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-00dd6341-c1f7-41fb-82e5-3f95babb661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:44.556718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:44.579973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 104/211] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:44.606282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4681d3-cb66-408d-b288-bf035eb620f9 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.628694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 108/212] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:44.643320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd6341-c1f7-41fb-82e5-3f95babb661b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.716197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4681d3-cb66-408d-b288-bf035eb620f9 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.746636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd6341-c1f7-41fb-82e5-3f95babb661b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.750458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:44.754011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b963252-4bdb-4702-bfcd-a59673754e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.754661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b963252-4bdb-4702-bfcd-a59673754e54 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.754938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b963252-4bdb-4702-bfcd-a59673754e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.755205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b963252-4bdb-4702-bfcd-a59673754e54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.767097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b963252-4bdb-4702-bfcd-a59673754e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-8b963252-4bdb-4702-bfcd-a59673754e54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:44.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:44.772861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:44.773616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 105/213] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:44.780921 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b963252-4bdb-4702-bfcd-a59673754e54 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.792065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9eaab-93fa-42d4-886d-ceec75017959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.792929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9eaab-93fa-42d4-886d-ceec75017959 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.793343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9eaab-93fa-42d4-886d-ceec75017959 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.793771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9eaab-93fa-42d4-886d-ceec75017959 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.795000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9eaab-93fa-42d4-886d-ceec75017959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:44.797806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9eaab-93fa-42d4-886d-ceec75017959 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:44.799556 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 109/214] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:44.805263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9eaab-93fa-42d4-886d-ceec75017959 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.837057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:44.903476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b963252-4bdb-4702-bfcd-a59673754e54 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.915636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9eaab-93fa-42d4-886d-ceec75017959 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.936883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779ec32-ad39-48d7-996b-7aadb6192a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.938104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ec32-ad39-48d7-996b-7aadb6192a7b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.938385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ec32-ad39-48d7-996b-7aadb6192a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.938651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ec32-ad39-48d7-996b-7aadb6192a7b None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.939311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779ec32-ad39-48d7-996b-7aadb6192a7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:44.939610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779ec32-ad39-48d7-996b-7aadb6192a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:44.941026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779ec32-ad39-48d7-996b-7aadb6192a7b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:44.952682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 106/215] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:44.952682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e121-1c89-4c97-8c36-355d925e016d None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.952682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e121-1c89-4c97-8c36-355d925e016d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.952682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e121-1c89-4c97-8c36-355d925e016d None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.952682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 107/216] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:44.955694 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807e121-1c89-4c97-8c36-355d925e016d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.963341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85124d-af51-4430-9bbd-afc24127efab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.963949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85124d-af51-4430-9bbd-afc24127efab None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.964227 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85124d-af51-4430-9bbd-afc24127efab None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.964499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85124d-af51-4430-9bbd-afc24127efab None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.965184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85124d-af51-4430-9bbd-afc24127efab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:44.966668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85124d-af51-4430-9bbd-afc24127efab None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:44.995450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 110/217] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:08:44 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:08:44.995450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6a32-39ce-4443-bfa3-471882dc61fa None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.995450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6a32-39ce-4443-bfa3-471882dc61fa None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.995450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6a32-39ce-4443-bfa3-471882dc61fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:45.014527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ad6c6a32-39ce-4443-bfa3-471882dc61fa None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:45.016649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ad6c6a32-39ce-4443-bfa3-471882dc61fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:45.052564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:45.088892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807e121-1c89-4c97-8c36-355d925e016d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:45.090873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:45.122149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 111/218] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:45.133058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa7370-6f58-4add-877f-5ffc37d45ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:45.133849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa7370-6f58-4add-877f-5ffc37d45ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:45.134238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa7370-6f58-4add-877f-5ffc37d45ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:45.134577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa7370-6f58-4add-877f-5ffc37d45ca6 None admin] PATH_INFO: `/v3/users/eec162abda4b462486b0b26d6fd84fc3` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:45.145935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c6a32-39ce-4443-bfa3-471882dc61fa None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:45.150873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa7370-6f58-4add-877f-5ffc37d45ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=eec162abda4b462486b0b26d6fd84fc3)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:45.152440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa7370-6f58-4add-877f-5ffc37d45ca6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:45.154511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 108/219] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:44 2022] GET /identity/v3/users/eec162abda4b462486b0b26d6fd84fc3 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:45.161355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa7370-6f58-4add-877f-5ffc37d45ca6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:45.260983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c6a32-39ce-4443-bfa3-471882dc61fa None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:45.298868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa7370-6f58-4add-877f-5ffc37d45ca6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:45.315487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a891c7-9b9e-43ed-a569-05498242b430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:45.316191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a891c7-9b9e-43ed-a569-05498242b430 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:45.316613 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a891c7-9b9e-43ed-a569-05498242b430 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:45.318464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a891c7-9b9e-43ed-a569-05498242b430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:45.332322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a891c7-9b9e-43ed-a569-05498242b430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a5a891c7-9b9e-43ed-a569-05498242b430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:45.337195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:45.338051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:45.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 112/220] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:45.344955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a891c7-9b9e-43ed-a569-05498242b430 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:45.357326 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907bb2a-809e-4bc2-aefc-e7bd2c21922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:45.357960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907bb2a-809e-4bc2-aefc-e7bd2c21922b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:45.358240 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907bb2a-809e-4bc2-aefc-e7bd2c21922b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:45.358509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907bb2a-809e-4bc2-aefc-e7bd2c21922b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:45.367540 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:45.395278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:45.455335 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907bb2a-809e-4bc2-aefc-e7bd2c21922b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:45.456851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907bb2a-809e-4bc2-aefc-e7bd2c21922b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:45.488486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a891c7-9b9e-43ed-a569-05498242b430 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:45.528194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31729e0d-b831-43f4-b2ec-f85ec6a3b5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:45.529224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31729e0d-b831-43f4-b2ec-f85ec6a3b5ab None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:45.529707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31729e0d-b831-43f4-b2ec-f85ec6a3b5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:45.530175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31729e0d-b831-43f4-b2ec-f85ec6a3b5ab None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:45.531607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31729e0d-b831-43f4-b2ec-f85ec6a3b5ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:45.532188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31729e0d-b831-43f4-b2ec-f85ec6a3b5ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:45.533821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31729e0d-b831-43f4-b2ec-f85ec6a3b5ab None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:45.543260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 113/221] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:45.549231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31729e0d-b831-43f4-b2ec-f85ec6a3b5ab None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:45.570365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 109/222] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:08:45.576670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907bb2a-809e-4bc2-aefc-e7bd2c21922b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:45.653092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:45.660231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:45.680173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31729e0d-b831-43f4-b2ec-f85ec6a3b5ab None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:45.702217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907bb2a-809e-4bc2-aefc-e7bd2c21922b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:45.715671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bc91f-4f05-409d-92c1-95d0c90e576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:45.716303 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bc91f-4f05-409d-92c1-95d0c90e576b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:45.716576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bc91f-4f05-409d-92c1-95d0c90e576b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:45.716874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bc91f-4f05-409d-92c1-95d0c90e576b None admin] PATH_INFO: `/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:45.718044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bc91f-4f05-409d-92c1-95d0c90e576b None admin] RBAC: Authorizing `identity:get_user(user_id=2e24a9a4863b4b21a3a292fca9a07e6c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:45.719805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bc91f-4f05-409d-92c1-95d0c90e576b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:45.722011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 114/223] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:45 2022] GET /identity/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:45.723240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f634f6-170e-466e-9f23-fd9dda53de6e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:45.723514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f634f6-170e-466e-9f23-fd9dda53de6e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:45.723778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f634f6-170e-466e-9f23-fd9dda53de6e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:45.725423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 115/224] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:45.727808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f634f6-170e-466e-9f23-fd9dda53de6e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:45.749181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6c839-7e34-4915-8787-3e5856bb10d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:45.750480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6c839-7e34-4915-8787-3e5856bb10d4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:45.750821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6c839-7e34-4915-8787-3e5856bb10d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:45.751152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6c839-7e34-4915-8787-3e5856bb10d4 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:45.752840 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6c839-7e34-4915-8787-3e5856bb10d4 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:45.754998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6c839-7e34-4915-8787-3e5856bb10d4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:45.760729 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 110/225] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:45 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:45.761952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a603-fd95-4270-ab1f-4d661c77e64d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:45.763023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a603-fd95-4270-ab1f-4d661c77e64d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:45.763303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a603-fd95-4270-ab1f-4d661c77e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:45.785833 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-bd51a603-fd95-4270-ab1f-4d661c77e64d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:45.786996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bd51a603-fd95-4270-ab1f-4d661c77e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:45.857615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 111/226] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:45.858464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51a603-fd95-4270-ab1f-4d661c77e64d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:45.862222 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f634f6-170e-466e-9f23-fd9dda53de6e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:45.903381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90106f2a-c6ed-460f-b15c-06a961d2af80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:45.904888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90106f2a-c6ed-460f-b15c-06a961d2af80 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:45.905266 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90106f2a-c6ed-460f-b15c-06a961d2af80 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:45.905921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90106f2a-c6ed-460f-b15c-06a961d2af80 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:45.907427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90106f2a-c6ed-460f-b15c-06a961d2af80 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:45.909632 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90106f2a-c6ed-460f-b15c-06a961d2af80 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:45.912635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 116/227] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:45 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:45.913625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90106f2a-c6ed-460f-b15c-06a961d2af80 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:45.939355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:45.941914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:45.996878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51a603-fd95-4270-ab1f-4d661c77e64d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:46.037795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90106f2a-c6ed-460f-b15c-06a961d2af80 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:46.042878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab1a2a-7071-455d-b885-ee08498a5522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:46.043479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab1a2a-7071-455d-b885-ee08498a5522 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:46.043751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab1a2a-7071-455d-b885-ee08498a5522 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:46.048656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab1a2a-7071-455d-b885-ee08498a5522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:46.048656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab1a2a-7071-455d-b885-ee08498a5522 None admin] RBAC: Adding query filter params (role.id=12dc9c7d75da4722bf4525a56eea0e47, scope.project.id=fe25744415024ccba84b98723af57001, user.id=eec162abda4b462486b0b26d6fd84fc3) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:46.048656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab1a2a-7071-455d-b885-ee08498a5522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:46.048656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab1a2a-7071-455d-b885-ee08498a5522 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:46.056488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 112/228] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:45 2022] GET /identity/v3/role_assignments?user.id=eec162abda4b462486b0b26d6fd84fc3&scope.project.id=fe25744415024ccba84b98723af57001&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:46.057432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab1a2a-7071-455d-b885-ee08498a5522 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:46.106343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752868f-2640-4cfd-aa79-12713ea9664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:46.107411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752868f-2640-4cfd-aa79-12713ea9664e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:46.107760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752868f-2640-4cfd-aa79-12713ea9664e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:46.108127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752868f-2640-4cfd-aa79-12713ea9664e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:46.133404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752868f-2640-4cfd-aa79-12713ea9664e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f752868f-2640-4cfd-aa79-12713ea9664e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:46.141785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:46.144203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:46.146176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 117/229] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:08:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:46.152647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752868f-2640-4cfd-aa79-12713ea9664e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:46.181034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab1a2a-7071-455d-b885-ee08498a5522 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:46.209431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:46.224482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae472d7-a2f7-4399-82ef-0a35ec85f109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:46.225330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae472d7-a2f7-4399-82ef-0a35ec85f109 None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:46.225605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae472d7-a2f7-4399-82ef-0a35ec85f109 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:46.225908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae472d7-a2f7-4399-82ef-0a35ec85f109 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001/users/2e24a9a4863b4b21a3a292fca9a07e6c/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:46.228223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae472d7-a2f7-4399-82ef-0a35ec85f109 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe25744415024ccba84b98723af57001, user_id=2e24a9a4863b4b21a3a292fca9a07e6c, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:46.230305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae472d7-a2f7-4399-82ef-0a35ec85f109 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:46.271284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 113/230] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:46 2022] PUT /identity/v3/projects/fe25744415024ccba84b98723af57001/users/2e24a9a4863b4b21a3a292fca9a07e6c/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:46.295911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:46.323660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752868f-2640-4cfd-aa79-12713ea9664e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:46.363259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3aa58-6b26-4233-9abf-035ad689c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:46.363870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3aa58-6b26-4233-9abf-035ad689c8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:46.364146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3aa58-6b26-4233-9abf-035ad689c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:46.364413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3aa58-6b26-4233-9abf-035ad689c8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:46.365122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3aa58-6b26-4233-9abf-035ad689c8a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:46.365485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3aa58-6b26-4233-9abf-035ad689c8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:46.366858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3aa58-6b26-4233-9abf-035ad689c8a3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:46.377356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 118/231] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:08:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:46.383499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae472d7-a2f7-4399-82ef-0a35ec85f109 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:46.494727 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae472d7-a2f7-4399-82ef-0a35ec85f109 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:46.532286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c7caf-9714-467f-8967-dbc17b7ce139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:46.533018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c7caf-9714-467f-8967-dbc17b7ce139 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:46.533298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c7caf-9714-467f-8967-dbc17b7ce139 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:46.533570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c7caf-9714-467f-8967-dbc17b7ce139 None admin] PATH_INFO: `/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:46.534780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c7caf-9714-467f-8967-dbc17b7ce139 None admin] RBAC: Authorizing `identity:get_user(user_id=2e24a9a4863b4b21a3a292fca9a07e6c)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:46.536236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c7caf-9714-467f-8967-dbc17b7ce139 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:46.538389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 114/232] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:46 2022] GET /identity/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:46.544204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3aa58-6b26-4233-9abf-035ad689c8a3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:46.659433 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3aa58-6b26-4233-9abf-035ad689c8a3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:46.695324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005900d3-baea-42e4-88d5-630a32e66994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:46.696053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005900d3-baea-42e4-88d5-630a32e66994 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:46.696333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005900d3-baea-42e4-88d5-630a32e66994 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:46.696606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005900d3-baea-42e4-88d5-630a32e66994 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:46.697786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005900d3-baea-42e4-88d5-630a32e66994 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:46.699393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005900d3-baea-42e4-88d5-630a32e66994 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:46.701144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 119/233] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:46 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:46.707116 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c7caf-9714-467f-8967-dbc17b7ce139 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:46.786310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:46.849007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c7caf-9714-467f-8967-dbc17b7ce139 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:46.888039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89f3bc-a9a0-429c-8172-1011532ec7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:46.888967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f3bc-a9a0-429c-8172-1011532ec7bb None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:46.889391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f3bc-a9a0-429c-8172-1011532ec7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:46.889805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f3bc-a9a0-429c-8172-1011532ec7bb None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001/users/2e24a9a4863b4b21a3a292fca9a07e6c/roles/c6822f728eca477f81827dcc4c547bd0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:46.892707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89f3bc-a9a0-429c-8172-1011532ec7bb None admin] RBAC: Authorizing `identity:create_grant(project_id=fe25744415024ccba84b98723af57001, user_id=2e24a9a4863b4b21a3a292fca9a07e6c, role_id=c6822f728eca477f81827dcc4c547bd0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:46.894407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89f3bc-a9a0-429c-8172-1011532ec7bb None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:46.915020 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 115/234] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:46 2022] PUT /identity/v3/projects/fe25744415024ccba84b98723af57001/users/2e24a9a4863b4b21a3a292fca9a07e6c/roles/c6822f728eca477f81827dcc4c547bd0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:08:47.443261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779c1a-5944-49f6-9c91-e90b6b952f29 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:47.443578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779c1a-5944-49f6-9c91-e90b6b952f29 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:47.443814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779c1a-5944-49f6-9c91-e90b6b952f29 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:47.445208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 120/235] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:47.450490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919eb5b-1da3-45b8-924e-3250022cc599 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:47.451008 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919eb5b-1da3-45b8-924e-3250022cc599 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:47.451502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919eb5b-1da3-45b8-924e-3250022cc599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:47.470760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-0919eb5b-1da3-45b8-924e-3250022cc599 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:47.472278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0919eb5b-1da3-45b8-924e-3250022cc599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:47.563011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 116/236] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:47.598826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d779c1a-5944-49f6-9c91-e90b6b952f29 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:47.611308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:47.750911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d779c1a-5944-49f6-9c91-e90b6b952f29 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:47.756782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b526b7-1f4f-4ab1-a75e-d4e061519b3d None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:47.757251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b526b7-1f4f-4ab1-a75e-d4e061519b3d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:47.757325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b526b7-1f4f-4ab1-a75e-d4e061519b3d None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:47.758668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 117/237] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:47.769681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07949880-a747-4edd-ad3c-0dcefaf9d314 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:47.769950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07949880-a747-4edd-ad3c-0dcefaf9d314 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:47.770224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07949880-a747-4edd-ad3c-0dcefaf9d314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:47.802973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-07949880-a747-4edd-ad3c-0dcefaf9d314 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:47.804181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-07949880-a747-4edd-ad3c-0dcefaf9d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:47.824108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eea99-037e-4a85-b0c8-aa36a8286809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:47.824778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eea99-037e-4a85-b0c8-aa36a8286809 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:47.825057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eea99-037e-4a85-b0c8-aa36a8286809 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:47.825327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eea99-037e-4a85-b0c8-aa36a8286809 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:47.848326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7eea99-037e-4a85-b0c8-aa36a8286809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-4e7eea99-037e-4a85-b0c8-aa36a8286809 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:47.853668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:47.854546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:47.855353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 121/238] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:47.861714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eea99-037e-4a85-b0c8-aa36a8286809 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:47.884987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:47.947883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 118/239] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:47.985015 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:48.009137 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07949880-a747-4edd-ad3c-0dcefaf9d314 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:48.049064 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eea99-037e-4a85-b0c8-aa36a8286809 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:48.111889 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faf1cb-6ebc-4977-839e-1f2a375ef7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:48.112498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faf1cb-6ebc-4977-839e-1f2a375ef7eb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:48.112799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faf1cb-6ebc-4977-839e-1f2a375ef7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:48.113067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faf1cb-6ebc-4977-839e-1f2a375ef7eb None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:48.113730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faf1cb-6ebc-4977-839e-1f2a375ef7eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:48.114027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faf1cb-6ebc-4977-839e-1f2a375ef7eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:48.115405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faf1cb-6ebc-4977-839e-1f2a375ef7eb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:48.135483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 122/240] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:48.136870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faf1cb-6ebc-4977-839e-1f2a375ef7eb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:48.186723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07949880-a747-4edd-ad3c-0dcefaf9d314 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:48.256188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1388c-5152-4806-9746-011ddfd4ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:48.256849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1388c-5152-4806-9746-011ddfd4ed88 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:48.257126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1388c-5152-4806-9746-011ddfd4ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:48.257392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1388c-5152-4806-9746-011ddfd4ed88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:48.259752 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1388c-5152-4806-9746-011ddfd4ed88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:48.261185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1388c-5152-4806-9746-011ddfd4ed88 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:48.262754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 119/241] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:48.273519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1388c-5152-4806-9746-011ddfd4ed88 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:48.326098 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faf1cb-6ebc-4977-839e-1f2a375ef7eb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:48.373024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:48.394730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:48.407948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1388c-5152-4806-9746-011ddfd4ed88 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:48.412310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcb9fb-b6c4-440c-958f-9afe8b95fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:48.412979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcb9fb-b6c4-440c-958f-9afe8b95fbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:48.413254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcb9fb-b6c4-440c-958f-9afe8b95fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:48.413520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcb9fb-b6c4-440c-958f-9afe8b95fbe8 None admin] PATH_INFO: `/v3/users/e65aa366ccca4805abd94cba60b877ab` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:48.431754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcb9fb-b6c4-440c-958f-9afe8b95fbe8 None admin] RBAC: Authorizing `identity:get_user(user_id=e65aa366ccca4805abd94cba60b877ab)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:48.433342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcb9fb-b6c4-440c-958f-9afe8b95fbe8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:48.435173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 123/242] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:48 2022] GET /identity/v3/users/e65aa366ccca4805abd94cba60b877ab => generated 297 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:48.436342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af2e0-fca1-4cb2-9fc8-bcf2398a9343 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:48.436617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af2e0-fca1-4cb2-9fc8-bcf2398a9343 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:48.441428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af2e0-fca1-4cb2-9fc8-bcf2398a9343 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:48.442846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 124/243] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:48.443570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38af2e0-fca1-4cb2-9fc8-bcf2398a9343 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:48.468148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd83c2-8bac-4eba-856c-0338ace68cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:48.469353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd83c2-8bac-4eba-856c-0338ace68cc2 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:48.469629 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd83c2-8bac-4eba-856c-0338ace68cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:48.469896 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd83c2-8bac-4eba-856c-0338ace68cc2 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:48.470546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd83c2-8bac-4eba-856c-0338ace68cc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:48.471992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd83c2-8bac-4eba-856c-0338ace68cc2 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:48.506296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 120/244] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:08:48 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:08:48.508192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102138-49aa-462e-993c-04f241c5c681 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:48.508927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102138-49aa-462e-993c-04f241c5c681 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:48.509644 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102138-49aa-462e-993c-04f241c5c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:48.551637 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-bc102138-49aa-462e-993c-04f241c5c681 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:48.554216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bc102138-49aa-462e-993c-04f241c5c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:48.637429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38af2e0-fca1-4cb2-9fc8-bcf2398a9343 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:48.698966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 121/245] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:48.709275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86d5c-8d27-4b5c-8734-1e20ad77869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:48.710357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86d5c-8d27-4b5c-8734-1e20ad77869d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:48.710887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86d5c-8d27-4b5c-8734-1e20ad77869d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:48.711442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86d5c-8d27-4b5c-8734-1e20ad77869d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:48.742574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc102138-49aa-462e-993c-04f241c5c681 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:48.778122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:48.787404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:48.805577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86d5c-8d27-4b5c-8734-1e20ad77869d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:48.807655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86d5c-8d27-4b5c-8734-1e20ad77869d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:48.891798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc102138-49aa-462e-993c-04f241c5c681 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:48.939813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407117e1-940a-4e76-8e8d-08e8c6f77bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:48.940455 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407117e1-940a-4e76-8e8d-08e8c6f77bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:48.940760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407117e1-940a-4e76-8e8d-08e8c6f77bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:48.941032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407117e1-940a-4e76-8e8d-08e8c6f77bb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:48.954296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407117e1-940a-4e76-8e8d-08e8c6f77bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:48.957607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 125/246] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-407117e1-940a-4e76-8e8d-08e8c6f77bb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:48.959139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:48.960151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:48.961117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 122/247] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:48.966011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86d5c-8d27-4b5c-8734-1e20ad77869d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:48.966646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407117e1-940a-4e76-8e8d-08e8c6f77bb5 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:49.079779 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:49.081699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:49.102299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407117e1-940a-4e76-8e8d-08e8c6f77bb5 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:49.117710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86d5c-8d27-4b5c-8734-1e20ad77869d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:49.174052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d239a7d-cb7e-465f-aa9c-71ec1676cfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:49.174937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d239a7d-cb7e-465f-aa9c-71ec1676cfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:49.175211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d239a7d-cb7e-465f-aa9c-71ec1676cfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:49.175480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d239a7d-cb7e-465f-aa9c-71ec1676cfd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:49.176150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d239a7d-cb7e-465f-aa9c-71ec1676cfd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:49.176447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d239a7d-cb7e-465f-aa9c-71ec1676cfd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:49.177870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d239a7d-cb7e-465f-aa9c-71ec1676cfd7 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:49.183611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a74d50-02fc-4c93-a460-dffd5fa78d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:49.184252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74d50-02fc-4c93-a460-dffd5fa78d35 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:49.184526 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74d50-02fc-4c93-a460-dffd5fa78d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:49.184817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74d50-02fc-4c93-a460-dffd5fa78d35 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:49.189094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a74d50-02fc-4c93-a460-dffd5fa78d35 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:49.190612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a74d50-02fc-4c93-a460-dffd5fa78d35 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:49.192590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 126/248] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:48 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:49.194417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b3453-ea8d-447b-902e-0053a231f9d6 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:49.194693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b3453-ea8d-447b-902e-0053a231f9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:49.194963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b3453-ea8d-447b-902e-0053a231f9d6 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:49.199969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 127/249] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:49.200528 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b3453-ea8d-447b-902e-0053a231f9d6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:49.201544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 123/250] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:49.210538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96d4b-7838-42f6-af3f-3a088dd187eb None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:49.210821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96d4b-7838-42f6-af3f-3a088dd187eb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:49.211094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96d4b-7838-42f6-af3f-3a088dd187eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:49.243586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-55b96d4b-7838-42f6-af3f-3a088dd187eb None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:49.244845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-55b96d4b-7838-42f6-af3f-3a088dd187eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:49.377700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b3453-ea8d-447b-902e-0053a231f9d6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:49.408589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 124/251] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:49.409498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b96d4b-7838-42f6-af3f-3a088dd187eb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:49.429903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be28ac3-45e4-4a2a-8558-f0e3939f83d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:49.430524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28ac3-45e4-4a2a-8558-f0e3939f83d1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:49.430801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28ac3-45e4-4a2a-8558-f0e3939f83d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:49.431071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28ac3-45e4-4a2a-8558-f0e3939f83d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:49.431808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be28ac3-45e4-4a2a-8558-f0e3939f83d1 None admin] RBAC: Adding query filter params (role.id=907e76e063c343839d29a28f402e588b, scope.project.id=fe25744415024ccba84b98723af57001, user.id=e65aa366ccca4805abd94cba60b877ab) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:49.432116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be28ac3-45e4-4a2a-8558-f0e3939f83d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:49.433586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be28ac3-45e4-4a2a-8558-f0e3939f83d1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:49.448090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 128/252] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:49 2022] GET /identity/v3/role_assignments?user.id=e65aa366ccca4805abd94cba60b877ab&scope.project.id=fe25744415024ccba84b98723af57001&role.id=907e76e063c343839d29a28f402e588b => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:49.448972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be28ac3-45e4-4a2a-8558-f0e3939f83d1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:49.490463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:49.635056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:49.665530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be28ac3-45e4-4a2a-8558-f0e3939f83d1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:49.684066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b96d4b-7838-42f6-af3f-3a088dd187eb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:49.731555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fceb6-3351-4a8b-95af-b712acd23214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:49.732638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fceb6-3351-4a8b-95af-b712acd23214 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:49.734800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fceb6-3351-4a8b-95af-b712acd23214 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:49.735272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fceb6-3351-4a8b-95af-b712acd23214 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:49.747567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba03e5-8319-4de9-ae0a-0e3386cf3c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:49.748460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba03e5-8319-4de9-ae0a-0e3386cf3c5f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:49.748989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba03e5-8319-4de9-ae0a-0e3386cf3c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:49.749424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba03e5-8319-4de9-ae0a-0e3386cf3c5f None admin] PATH_INFO: `/v3/users/eec162abda4b462486b0b26d6fd84fc3` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:49.752669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba03e5-8319-4de9-ae0a-0e3386cf3c5f None admin] RBAC: Authorizing `identity:get_user(user_id=eec162abda4b462486b0b26d6fd84fc3)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:49.756918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba03e5-8319-4de9-ae0a-0e3386cf3c5f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:49.758935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fceb6-3351-4a8b-95af-b712acd23214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:49.763362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 125/253] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:49 2022] GET /identity/v3/users/eec162abda4b462486b0b26d6fd84fc3 => generated 297 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:49.764723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9eac9-2910-4e75-8218-2aed769f7ba8 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:49.765178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9eac9-2910-4e75-8218-2aed769f7ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:49.765588 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9eac9-2910-4e75-8218-2aed769f7ba8 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-0e5fceb6-3351-4a8b-95af-b712acd23214 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:49.769156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:49.770231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:49.771132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:49.771903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 126/254] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:49.772772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9eac9-2910-4e75-8218-2aed769f7ba8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:49.776917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 129/255] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:49.778307 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d730-d54c-473b-9ff8-d243ecf8c8af None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:49.779567 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d730-d54c-473b-9ff8-d243ecf8c8af None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:49.779979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d730-d54c-473b-9ff8-d243ecf8c8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:49.815630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fdf1d730-d54c-473b-9ff8-d243ecf8c8af None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:49.818085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fdf1d730-d54c-473b-9ff8-d243ecf8c8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:49.901228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 130/256] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:49.902285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d730-d54c-473b-9ff8-d243ecf8c8af None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:49.913413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:49.917724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9eac9-2910-4e75-8218-2aed769f7ba8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:49.953915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9b2dc-dd73-4804-8b4a-f418f59da9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:49.954773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9b2dc-dd73-4804-8b4a-f418f59da9fb None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:49.955233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9b2dc-dd73-4804-8b4a-f418f59da9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:49.955608 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9b2dc-dd73-4804-8b4a-f418f59da9fb None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:49.956915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9b2dc-dd73-4804-8b4a-f418f59da9fb None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:49.964645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9b2dc-dd73-4804-8b4a-f418f59da9fb None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:49.964836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 127/257] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:49 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:49.965720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9b2dc-dd73-4804-8b4a-f418f59da9fb None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:49.984944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:50.057981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d730-d54c-473b-9ff8-d243ecf8c8af None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.112805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d29c-c7f5-4cbc-97ad-f117577b5d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.113783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d29c-c7f5-4cbc-97ad-f117577b5d14 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.114258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d29c-c7f5-4cbc-97ad-f117577b5d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.114746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d29c-c7f5-4cbc-97ad-f117577b5d14 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.115609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d29c-c7f5-4cbc-97ad-f117577b5d14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:50.116103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d29c-c7f5-4cbc-97ad-f117577b5d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:50.117717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d29c-c7f5-4cbc-97ad-f117577b5d14 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:50.127465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 131/258] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:50.128544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d29c-c7f5-4cbc-97ad-f117577b5d14 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.137977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9b2dc-dd73-4804-8b4a-f418f59da9fb None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.208931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:50.210686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc2d81-1e18-4726-ac6c-d6b4f1b80a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.210686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc2d81-1e18-4726-ac6c-d6b4f1b80a09 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.211014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc2d81-1e18-4726-ac6c-d6b4f1b80a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.211221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc2d81-1e18-4726-ac6c-d6b4f1b80a09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.235342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc2d81-1e18-4726-ac6c-d6b4f1b80a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-ccbc2d81-1e18-4726-ac6c-d6b4f1b80a09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:50.245642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:50.246632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:50.247415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 128/259] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:08:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:50.248076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc2d81-1e18-4726-ac6c-d6b4f1b80a09 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.251117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d29c-c7f5-4cbc-97ad-f117577b5d14 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.287149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd499e5-da54-4b43-ba43-49cc1d4bc755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.288174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd499e5-da54-4b43-ba43-49cc1d4bc755 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.288734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd499e5-da54-4b43-ba43-49cc1d4bc755 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.289206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd499e5-da54-4b43-ba43-49cc1d4bc755 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001/users/eec162abda4b462486b0b26d6fd84fc3/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.291442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd499e5-da54-4b43-ba43-49cc1d4bc755 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe25744415024ccba84b98723af57001, user_id=eec162abda4b462486b0b26d6fd84fc3, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:50.293133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd499e5-da54-4b43-ba43-49cc1d4bc755 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:50.325085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 132/260] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:50 2022] PUT /identity/v3/projects/fe25744415024ccba84b98723af57001/users/eec162abda4b462486b0b26d6fd84fc3/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:50.326443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd499e5-da54-4b43-ba43-49cc1d4bc755 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.394967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:50.463726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc2d81-1e18-4726-ac6c-d6b4f1b80a09 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.529387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff549b-be07-4f9c-bf8d-17eb0c5225ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.530050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff549b-be07-4f9c-bf8d-17eb0c5225ad None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.530330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff549b-be07-4f9c-bf8d-17eb0c5225ad None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.530692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff549b-be07-4f9c-bf8d-17eb0c5225ad None admin] PATH_INFO: `/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.535578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff549b-be07-4f9c-bf8d-17eb0c5225ad None admin] RBAC: Authorizing `identity:get_user(user_id=2e24a9a4863b4b21a3a292fca9a07e6c)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:50.536410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd499e5-da54-4b43-ba43-49cc1d4bc755 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.537183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff549b-be07-4f9c-bf8d-17eb0c5225ad None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:50.538907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 129/261] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:50.545087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff549b-be07-4f9c-bf8d-17eb0c5225ad None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.573005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:50.594961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241d9c-c044-44e6-898b-ea9aeac3fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.599736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241d9c-c044-44e6-898b-ea9aeac3fff8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.599736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241d9c-c044-44e6-898b-ea9aeac3fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.599736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241d9c-c044-44e6-898b-ea9aeac3fff8 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.599736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66241d9c-c044-44e6-898b-ea9aeac3fff8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:50.599736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66241d9c-c044-44e6-898b-ea9aeac3fff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:50.599736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66241d9c-c044-44e6-898b-ea9aeac3fff8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:50.616708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 133/262] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:50.622125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241d9c-c044-44e6-898b-ea9aeac3fff8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.732546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241d9c-c044-44e6-898b-ea9aeac3fff8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.733482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff549b-be07-4f9c-bf8d-17eb0c5225ad None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.775210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece49e0-9b72-4f0b-9257-0b1571eea8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.775861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece49e0-9b72-4f0b-9257-0b1571eea8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.776140 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece49e0-9b72-4f0b-9257-0b1571eea8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.776437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece49e0-9b72-4f0b-9257-0b1571eea8f1 None admin] PATH_INFO: `/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.780200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece49e0-9b72-4f0b-9257-0b1571eea8f1 None admin] RBAC: Authorizing `identity:get_user(user_id=2e24a9a4863b4b21a3a292fca9a07e6c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:50.780200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece49e0-9b72-4f0b-9257-0b1571eea8f1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:50.781395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 134/263] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/users/2e24a9a4863b4b21a3a292fca9a07e6c => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:50.786854 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece49e0-9b72-4f0b-9257-0b1571eea8f1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.789496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b95fde-105f-4b7e-9f38-6783828c4b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.790320 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b95fde-105f-4b7e-9f38-6783828c4b03 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.790759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b95fde-105f-4b7e-9f38-6783828c4b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.791195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b95fde-105f-4b7e-9f38-6783828c4b03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.807169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:50.915890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:50.941033 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b95fde-105f-4b7e-9f38-6783828c4b03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:50.942541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b95fde-105f-4b7e-9f38-6783828c4b03 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.010352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece49e0-9b72-4f0b-9257-0b1571eea8f1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.102189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31206fc9-2cdc-460e-838d-bf01a8dadc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.102805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31206fc9-2cdc-460e-838d-bf01a8dadc46 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.103086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31206fc9-2cdc-460e-838d-bf01a8dadc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.103353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31206fc9-2cdc-460e-838d-bf01a8dadc46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.118487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 130/264] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:08:51.126083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b95fde-105f-4b7e-9f38-6783828c4b03 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.208991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.301775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31206fc9-2cdc-460e-838d-bf01a8dadc46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.303170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31206fc9-2cdc-460e-838d-bf01a8dadc46 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.306145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b95fde-105f-4b7e-9f38-6783828c4b03 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.372598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78e478-7504-49fc-9918-ae0ba53ec3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.373323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78e478-7504-49fc-9918-ae0ba53ec3ce None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.373600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78e478-7504-49fc-9918-ae0ba53ec3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.373866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78e478-7504-49fc-9918-ae0ba53ec3ce None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.377580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78e478-7504-49fc-9918-ae0ba53ec3ce None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.379323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78e478-7504-49fc-9918-ae0ba53ec3ce None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.381109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 131/265] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:51.386970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78e478-7504-49fc-9918-ae0ba53ec3ce None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.444548 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.504924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 135/266] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:08:51.513708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31206fc9-2cdc-460e-838d-bf01a8dadc46 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.575784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78e478-7504-49fc-9918-ae0ba53ec3ce None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.597271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.648201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c4cb7-cb63-4552-879d-5d4b4402aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.648843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c4cb7-cb63-4552-879d-5d4b4402aab0 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.649121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c4cb7-cb63-4552-879d-5d4b4402aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.649389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c4cb7-cb63-4552-879d-5d4b4402aab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.650114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c4cb7-cb63-4552-879d-5d4b4402aab0 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=fe25744415024ccba84b98723af57001, user.id=2e24a9a4863b4b21a3a292fca9a07e6c) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:51.650420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c4cb7-cb63-4552-879d-5d4b4402aab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.651863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c4cb7-cb63-4552-879d-5d4b4402aab0 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.667742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 132/267] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/role_assignments?user.id=2e24a9a4863b4b21a3a292fca9a07e6c&scope.project.id=fe25744415024ccba84b98723af57001&role.id=d6155b01aace49f887f29aa2861d31cf => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:51.669008 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddd03b-b431-4281-89fc-b2ce3f8f3aa1 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.669288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddd03b-b431-4281-89fc-b2ce3f8f3aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.669556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddd03b-b431-4281-89fc-b2ce3f8f3aa1 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.670898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 133/268] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:51.678820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50483be8-64a2-4ba1-b204-38d96c934cbb None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.679128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50483be8-64a2-4ba1-b204-38d96c934cbb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.679356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50483be8-64a2-4ba1-b204-38d96c934cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.686826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31206fc9-2cdc-460e-838d-bf01a8dadc46 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.710321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-50483be8-64a2-4ba1-b204-38d96c934cbb None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:51.711543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-50483be8-64a2-4ba1-b204-38d96c934cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:51.747619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393f13d-a870-4db0-9267-3681d3889057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.748270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393f13d-a870-4db0-9267-3681d3889057 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.748537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393f13d-a870-4db0-9267-3681d3889057 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.748843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393f13d-a870-4db0-9267-3681d3889057 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.753438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393f13d-a870-4db0-9267-3681d3889057 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.754958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393f13d-a870-4db0-9267-3681d3889057 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.760071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 136/269] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:51.760071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019d0cf-0c41-4be3-8901-4eb486cf18f7 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.760071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019d0cf-0c41-4be3-8901-4eb486cf18f7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.760071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019d0cf-0c41-4be3-8901-4eb486cf18f7 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.760071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 137/270] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:51.768243 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0ced-6cd0-4478-924b-43f84cbe412b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.768243 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0ced-6cd0-4478-924b-43f84cbe412b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.768243 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0ced-6cd0-4478-924b-43f84cbe412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.796017 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 134/271] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:51.796416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1ffd0ced-6cd0-4478-924b-43f84cbe412b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:51.797932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1ffd0ced-6cd0-4478-924b-43f84cbe412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:51.801802 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50483be8-64a2-4ba1-b204-38d96c934cbb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.824754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.887099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 138/272] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:51.887968 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd0ced-6cd0-4478-924b-43f84cbe412b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.944581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50483be8-64a2-4ba1-b204-38d96c934cbb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.946129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.993686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1c9d-11a2-4041-8024-f87a5e924785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.994301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1c9d-11a2-4041-8024-f87a5e924785 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.994578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1c9d-11a2-4041-8024-f87a5e924785 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.994844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1c9d-11a2-4041-8024-f87a5e924785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.995573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd1c9d-11a2-4041-8024-f87a5e924785 None admin] RBAC: Adding query filter params (role.id=c6822f728eca477f81827dcc4c547bd0, scope.project.id=fe25744415024ccba84b98723af57001, user.id=2e24a9a4863b4b21a3a292fca9a07e6c) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:51.995881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd1c9d-11a2-4041-8024-f87a5e924785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.997768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd1c9d-11a2-4041-8024-f87a5e924785 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.007109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 135/273] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/role_assignments?user.id=2e24a9a4863b4b21a3a292fca9a07e6c&scope.project.id=fe25744415024ccba84b98723af57001&role.id=c6822f728eca477f81827dcc4c547bd0 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:52.007996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1c9d-11a2-4041-8024-f87a5e924785 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.011022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd0ced-6cd0-4478-924b-43f84cbe412b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.069440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e45cfb-7d58-42f9-a7f4-075292f561fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.071211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e45cfb-7d58-42f9-a7f4-075292f561fd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.071705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e45cfb-7d58-42f9-a7f4-075292f561fd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.072184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e45cfb-7d58-42f9-a7f4-075292f561fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.074036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e45cfb-7d58-42f9-a7f4-075292f561fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.075769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e45cfb-7d58-42f9-a7f4-075292f561fd None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.077805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 139/274] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:52.083781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e45cfb-7d58-42f9-a7f4-075292f561fd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.135059 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.184556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1c9d-11a2-4041-8024-f87a5e924785 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.231075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64697cd7-4412-4e1e-88d1-bb64229b89c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.231900 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697cd7-4412-4e1e-88d1-bb64229b89c5 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.232177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697cd7-4412-4e1e-88d1-bb64229b89c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.232446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697cd7-4412-4e1e-88d1-bb64229b89c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.244830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e45cfb-7d58-42f9-a7f4-075292f561fd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.249511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64697cd7-4412-4e1e-88d1-bb64229b89c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-64697cd7-4412-4e1e-88d1-bb64229b89c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:52.255264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:52.256174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 136/275] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:52.258553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b74e3-335d-4ab7-b4ad-08bbf43b46d3 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.259253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b74e3-335d-4ab7-b4ad-08bbf43b46d3 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.259253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b74e3-335d-4ab7-b4ad-08bbf43b46d3 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.260281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 137/276] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:52.266674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b74e3-335d-4ab7-b4ad-08bbf43b46d3 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.288067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246b4bc-891e-45da-87d7-d7629bea20d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.288713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246b4bc-891e-45da-87d7-d7629bea20d9 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.288993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246b4bc-891e-45da-87d7-d7629bea20d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.289261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246b4bc-891e-45da-87d7-d7629bea20d9 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.289908 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246b4bc-891e-45da-87d7-d7629bea20d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.291343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246b4bc-891e-45da-87d7-d7629bea20d9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.303691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.317383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 140/277] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:08:52 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:08:52.318874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897f41e-aad8-4514-9e37-a51c451a8714 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.319404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897f41e-aad8-4514-9e37-a51c451a8714 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.319677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897f41e-aad8-4514-9e37-a51c451a8714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.351154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8897f41e-aad8-4514-9e37-a51c451a8714 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:52.352367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8897f41e-aad8-4514-9e37-a51c451a8714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:52.402158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b74e3-335d-4ab7-b4ad-08bbf43b46d3 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.440735 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 141/278] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:52.455773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a983ce-caee-4dd8-ac84-5601b68a5c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.456780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a983ce-caee-4dd8-ac84-5601b68a5c00 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.457263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a983ce-caee-4dd8-ac84-5601b68a5c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.457775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a983ce-caee-4dd8-ac84-5601b68a5c00 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.458676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a983ce-caee-4dd8-ac84-5601b68a5c00 None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:52.459208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a983ce-caee-4dd8-ac84-5601b68a5c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.461046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a983ce-caee-4dd8-ac84-5601b68a5c00 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.462286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897f41e-aad8-4514-9e37-a51c451a8714 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.479018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 138/279] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:52.482814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.485272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a983ce-caee-4dd8-ac84-5601b68a5c00 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.585406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.593336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897f41e-aad8-4514-9e37-a51c451a8714 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.600499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a983ce-caee-4dd8-ac84-5601b68a5c00 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.639450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbd6c2-7b47-4165-840e-8b9ea8bd9627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.640156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbd6c2-7b47-4165-840e-8b9ea8bd9627 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.640490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbd6c2-7b47-4165-840e-8b9ea8bd9627 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.640969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516477d-e5c2-4099-afb9-f76e7fd7b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.641104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbd6c2-7b47-4165-840e-8b9ea8bd9627 None admin] PATH_INFO: `/v3/users/7626cbdbef0642638a837644f0683c55` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.642293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516477d-e5c2-4099-afb9-f76e7fd7b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.642771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516477d-e5c2-4099-afb9-f76e7fd7b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.643234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516477d-e5c2-4099-afb9-f76e7fd7b7f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.658374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516477d-e5c2-4099-afb9-f76e7fd7b7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:52.662074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbd6c2-7b47-4165-840e-8b9ea8bd9627 None admin] RBAC: Authorizing `identity:get_user(user_id=7626cbdbef0642638a837644f0683c55)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a516477d-e5c2-4099-afb9-f76e7fd7b7f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:52.662402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:52.663282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:52.664076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 142/280] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:52.666648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbd6c2-7b47-4165-840e-8b9ea8bd9627 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.669701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 139/281] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/users/7626cbdbef0642638a837644f0683c55 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:52.669839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516477d-e5c2-4099-afb9-f76e7fd7b7f8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.675418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbd6c2-7b47-4165-840e-8b9ea8bd9627 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.750534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.794414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516477d-e5c2-4099-afb9-f76e7fd7b7f8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.794604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbd6c2-7b47-4165-840e-8b9ea8bd9627 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.832652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf034088-e2e9-4c11-9bf4-946a66480b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.833360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf034088-e2e9-4c11-9bf4-946a66480b40 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.833703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf034088-e2e9-4c11-9bf4-946a66480b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.834034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf034088-e2e9-4c11-9bf4-946a66480b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.834821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf034088-e2e9-4c11-9bf4-946a66480b40 None admin] RBAC: Adding query filter params (role.id=12dc9c7d75da4722bf4525a56eea0e47, user.id=7626cbdbef0642638a837644f0683c55, scope.system=all) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:52.835243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf034088-e2e9-4c11-9bf4-946a66480b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.836868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf034088-e2e9-4c11-9bf4-946a66480b40 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.842502 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7edfe4-3a73-4376-a093-00e3faa6f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.843844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 140/282] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/role_assignments?user.id=7626cbdbef0642638a837644f0683c55&scope.system=all&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:52.844354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7edfe4-3a73-4376-a093-00e3faa6f713 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.844710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7edfe4-3a73-4376-a093-00e3faa6f713 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.844937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7edfe4-3a73-4376-a093-00e3faa6f713 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.845586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7edfe4-3a73-4376-a093-00e3faa6f713 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:52.845887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7edfe4-3a73-4376-a093-00e3faa6f713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.847283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7edfe4-3a73-4376-a093-00e3faa6f713 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.860650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 143/283] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:52.863298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf034088-e2e9-4c11-9bf4-946a66480b40 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.917698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.979602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf034088-e2e9-4c11-9bf4-946a66480b40 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.019037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc389e13-1bd8-48f2-86b6-4a0f690bb3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.019602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389e13-1bd8-48f2-86b6-4a0f690bb3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.019882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389e13-1bd8-48f2-86b6-4a0f690bb3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.020150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389e13-1bd8-48f2-86b6-4a0f690bb3d5 None admin] PATH_INFO: `/v3/users/e65aa366ccca4805abd94cba60b877ab` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.021492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc389e13-1bd8-48f2-86b6-4a0f690bb3d5 None admin] RBAC: Authorizing `identity:get_user(user_id=e65aa366ccca4805abd94cba60b877ab)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.023048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc389e13-1bd8-48f2-86b6-4a0f690bb3d5 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.024772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 141/284] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/users/e65aa366ccca4805abd94cba60b877ab => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:53.030461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7edfe4-3a73-4376-a093-00e3faa6f713 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:53.049939 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663d18a-42ce-4d08-98e2-d0f965439d7a None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.050137 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663d18a-42ce-4d08-98e2-d0f965439d7a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.050270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663d18a-42ce-4d08-98e2-d0f965439d7a None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.051975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 142/285] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:53.064235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881eff3-28a9-4769-8fa3-e9b3668423fe None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.064577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881eff3-28a9-4769-8fa3-e9b3668423fe None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.064889 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881eff3-28a9-4769-8fa3-e9b3668423fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.089296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9881eff3-28a9-4769-8fa3-e9b3668423fe None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:53.090960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9881eff3-28a9-4769-8fa3-e9b3668423fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:53.168476 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7edfe4-3a73-4376-a093-00e3faa6f713 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.205074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b8b2d-b056-40f7-8954-849bf0363818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.205709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b8b2d-b056-40f7-8954-849bf0363818 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.205984 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b8b2d-b056-40f7-8954-849bf0363818 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.206251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b8b2d-b056-40f7-8954-849bf0363818 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.207382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b8b2d-b056-40f7-8954-849bf0363818 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.208848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b8b2d-b056-40f7-8954-849bf0363818 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.210851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 144/286] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:53.217156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b8b2d-b056-40f7-8954-849bf0363818 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:53.227871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:53.242957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 143/287] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:53.282313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881eff3-28a9-4769-8fa3-e9b3668423fe None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:53.301494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:53.349145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b8b2d-b056-40f7-8954-849bf0363818 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.398723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d8aed-33ed-48f3-9c40-6e0ab38f05a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.398948 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8aed-33ed-48f3-9c40-6e0ab38f05a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.399168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8aed-33ed-48f3-9c40-6e0ab38f05a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.399381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8aed-33ed-48f3-9c40-6e0ab38f05a5 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001/users/e65aa366ccca4805abd94cba60b877ab/roles/907e76e063c343839d29a28f402e588b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.408646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d8aed-33ed-48f3-9c40-6e0ab38f05a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe25744415024ccba84b98723af57001, user_id=e65aa366ccca4805abd94cba60b877ab, role_id=907e76e063c343839d29a28f402e588b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.408646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d8aed-33ed-48f3-9c40-6e0ab38f05a5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.425527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 145/288] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:53 2022] PUT /identity/v3/projects/fe25744415024ccba84b98723af57001/users/e65aa366ccca4805abd94cba60b877ab/roles/907e76e063c343839d29a28f402e588b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:08:53.472275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881eff3-28a9-4769-8fa3-e9b3668423fe None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.527650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadda643-a86e-42c6-a9e8-10c14f97d8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.528407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadda643-a86e-42c6-a9e8-10c14f97d8bc None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.528707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadda643-a86e-42c6-a9e8-10c14f97d8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.529018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadda643-a86e-42c6-a9e8-10c14f97d8bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.545510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadda643-a86e-42c6-a9e8-10c14f97d8bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-dadda643-a86e-42c6-a9e8-10c14f97d8bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:53.551461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:53.552381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:53.553197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 144/289] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:53.558941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d8aed-33ed-48f3-9c40-6e0ab38f05a5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:53.642455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:53.691752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d8aed-33ed-48f3-9c40-6e0ab38f05a5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.726838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434993e8-c152-4f3a-9866-1b4aa7a7c45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.727445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434993e8-c152-4f3a-9866-1b4aa7a7c45f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.727718 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434993e8-c152-4f3a-9866-1b4aa7a7c45f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.727987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434993e8-c152-4f3a-9866-1b4aa7a7c45f None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.728666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434993e8-c152-4f3a-9866-1b4aa7a7c45f None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:53.728974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434993e8-c152-4f3a-9866-1b4aa7a7c45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.730331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434993e8-c152-4f3a-9866-1b4aa7a7c45f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.739939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 146/290] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:53.745158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadda643-a86e-42c6-a9e8-10c14f97d8bc None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:53.818152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:53.866512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadda643-a86e-42c6-a9e8-10c14f97d8bc None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.906401 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea66e2e-44f5-45c2-87c8-27d51e54427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.907023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea66e2e-44f5-45c2-87c8-27d51e54427a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.907290 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea66e2e-44f5-45c2-87c8-27d51e54427a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.907555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea66e2e-44f5-45c2-87c8-27d51e54427a None admin] PATH_INFO: `/v3/users/eec162abda4b462486b0b26d6fd84fc3` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.908703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea66e2e-44f5-45c2-87c8-27d51e54427a None admin] RBAC: Authorizing `identity:get_user(user_id=eec162abda4b462486b0b26d6fd84fc3)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.910221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea66e2e-44f5-45c2-87c8-27d51e54427a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.912208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 145/291] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/users/eec162abda4b462486b0b26d6fd84fc3 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:53.920941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434993e8-c152-4f3a-9866-1b4aa7a7c45f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:54.031812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434993e8-c152-4f3a-9866-1b4aa7a7c45f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:54.058862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:54.080303 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f7dfb-ebc7-4885-87e1-a37021155454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:54.080881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f7dfb-ebc7-4885-87e1-a37021155454 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:54.081166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f7dfb-ebc7-4885-87e1-a37021155454 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:54.081487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f7dfb-ebc7-4885-87e1-a37021155454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:54.163569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f7dfb-ebc7-4885-87e1-a37021155454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:54.165123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f7dfb-ebc7-4885-87e1-a37021155454 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:54.271609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 147/292] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:54.276968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea66e2e-44f5-45c2-87c8-27d51e54427a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:54.408120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea66e2e-44f5-45c2-87c8-27d51e54427a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:54.462316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ae3b1-5daf-4676-a3cc-ae626d41d52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:54.462943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae3b1-5daf-4676-a3cc-ae626d41d52f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:54.463220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae3b1-5daf-4676-a3cc-ae626d41d52f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:54.463489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae3b1-5daf-4676-a3cc-ae626d41d52f None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:54.464599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ae3b1-5daf-4676-a3cc-ae626d41d52f None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:54.466063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ae3b1-5daf-4676-a3cc-ae626d41d52f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:54.467693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 146/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:54 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:54.474447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f7dfb-ebc7-4885-87e1-a37021155454 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:54.500142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:54.603880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f7dfb-ebc7-4885-87e1-a37021155454 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:54.647699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b9e85-5032-4288-b53c-bc5d45867ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:54.648367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9e85-5032-4288-b53c-bc5d45867ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:54.648663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9e85-5032-4288-b53c-bc5d45867ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:54.648939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9e85-5032-4288-b53c-bc5d45867ac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:54.649718 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b9e85-5032-4288-b53c-bc5d45867ac8 None admin] RBAC: Adding query filter params (role.id=12dc9c7d75da4722bf4525a56eea0e47, scope.project.id=fe25744415024ccba84b98723af57001, user.id=eec162abda4b462486b0b26d6fd84fc3) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:54.650027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b9e85-5032-4288-b53c-bc5d45867ac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:54.651467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b9e85-5032-4288-b53c-bc5d45867ac8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:54.657905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 148/294] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:54 2022] GET /identity/v3/role_assignments?user.id=eec162abda4b462486b0b26d6fd84fc3&scope.project.id=fe25744415024ccba84b98723af57001&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:55.093611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27b57-cd8e-4029-83f4-eba147f48056 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.094111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27b57-cd8e-4029-83f4-eba147f48056 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.094236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27b57-cd8e-4029-83f4-eba147f48056 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.095809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 147/295] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:55.101011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f4cc4-f914-4bf2-b6c9-035a5c54cb87 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.101473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f4cc4-f914-4bf2-b6c9-035a5c54cb87 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.101545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f4cc4-f914-4bf2-b6c9-035a5c54cb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.124052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-925f4cc4-f914-4bf2-b6c9-035a5c54cb87 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:55.125855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-925f4cc4-f914-4bf2-b6c9-035a5c54cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:55.168856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f09e-4351-454e-ad6a-03ec92d69d86 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.169161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f09e-4351-454e-ad6a-03ec92d69d86 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.169408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f09e-4351-454e-ad6a-03ec92d69d86 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.171010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 148/296] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:55.177124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb03b6-9ee3-42c3-8143-ec3423ec9a24 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.177404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb03b6-9ee3-42c3-8143-ec3423ec9a24 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.177680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb03b6-9ee3-42c3-8143-ec3423ec9a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.186538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:55.203233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5deb03b6-9ee3-42c3-8143-ec3423ec9a24 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:55.205405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5deb03b6-9ee3-42c3-8143-ec3423ec9a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:55.210042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 149/297] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:55.211569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0492a3-f8ce-4cf4-ad70-73018003dc94 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.212022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0492a3-f8ce-4cf4-ad70-73018003dc94 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.212439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0492a3-f8ce-4cf4-ad70-73018003dc94 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.213863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 150/298] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:55.219714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26ee7b-f391-415c-b750-5eb1e6acbbc5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.219988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26ee7b-f391-415c-b750-5eb1e6acbbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.220255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26ee7b-f391-415c-b750-5eb1e6acbbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.240845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2d26ee7b-f391-415c-b750-5eb1e6acbbc5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:55.242172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2d26ee7b-f391-415c-b750-5eb1e6acbbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:55.255870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:55.281415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 149/299] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:55.289673 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb03b6-9ee3-42c3-8143-ec3423ec9a24 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.322543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 151/300] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:55.323680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26ee7b-f391-415c-b750-5eb1e6acbbc5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.407773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb03b6-9ee3-42c3-8143-ec3423ec9a24 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.442623 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26ee7b-f391-415c-b750-5eb1e6acbbc5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.447331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d55719-f914-47cf-be00-4ce48217fa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.447959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d55719-f914-47cf-be00-4ce48217fa63 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.448235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d55719-f914-47cf-be00-4ce48217fa63 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.448503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d55719-f914-47cf-be00-4ce48217fa63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.449643 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d55719-f914-47cf-be00-4ce48217fa63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:55.451080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d55719-f914-47cf-be00-4ce48217fa63 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:55.452908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 150/301] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:55.453462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d55719-f914-47cf-be00-4ce48217fa63 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.458675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:55.485976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd195fa-af4b-41b2-a33d-1e0a796dfeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.486859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd195fa-af4b-41b2-a33d-1e0a796dfeca None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.487303 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd195fa-af4b-41b2-a33d-1e0a796dfeca None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.487707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd195fa-af4b-41b2-a33d-1e0a796dfeca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.497905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd195fa-af4b-41b2-a33d-1e0a796dfeca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7bd195fa-af4b-41b2-a33d-1e0a796dfeca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:55.503306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:55.504330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:55.505275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:55.507152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 152/302] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:55.512815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd195fa-af4b-41b2-a33d-1e0a796dfeca None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.525561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:55.559171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d55719-f914-47cf-be00-4ce48217fa63 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.594771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3f57d-37ff-4a67-a1b5-05fe6531c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.595490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3f57d-37ff-4a67-a1b5-05fe6531c2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.595772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3f57d-37ff-4a67-a1b5-05fe6531c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.596038 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3f57d-37ff-4a67-a1b5-05fe6531c2e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.606230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3f57d-37ff-4a67-a1b5-05fe6531c2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-11c3f57d-37ff-4a67-a1b5-05fe6531c2e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:55.612076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:55.612987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:55.613770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 151/303] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:55.614910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3f57d-37ff-4a67-a1b5-05fe6531c2e9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.626636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd195fa-af4b-41b2-a33d-1e0a796dfeca None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.661672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b313-9a57-4c4d-b44c-3c2fa9ea7a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.662204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b313-9a57-4c4d-b44c-3c2fa9ea7a2c None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.662484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b313-9a57-4c4d-b44c-3c2fa9ea7a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.662746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1b313-9a57-4c4d-b44c-3c2fa9ea7a2c None admin] PATH_INFO: `/v3/groups` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.663350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1b313-9a57-4c4d-b44c-3c2fa9ea7a2c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:55.664797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1b313-9a57-4c4d-b44c-3c2fa9ea7a2c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:55.688650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 153/304] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Aug 9 12:08:55 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:55.688650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b313-9a57-4c4d-b44c-3c2fa9ea7a2c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.691826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:55.748938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3f57d-37ff-4a67-a1b5-05fe6531c2e9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.757932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:55.794931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa3c8f-53e6-4d8e-bcf7-ee9b9d6e3a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.795625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa3c8f-53e6-4d8e-bcf7-ee9b9d6e3a04 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.795905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa3c8f-53e6-4d8e-bcf7-ee9b9d6e3a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.796110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1b313-9a57-4c4d-b44c-3c2fa9ea7a2c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.796804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa3c8f-53e6-4d8e-bcf7-ee9b9d6e3a04 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.797412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa3c8f-53e6-4d8e-bcf7-ee9b9d6e3a04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:55.797719 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa3c8f-53e6-4d8e-bcf7-ee9b9d6e3a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:55.800859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa3c8f-53e6-4d8e-bcf7-ee9b9d6e3a04 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:55.813924 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 152/305] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:55.819648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa3c8f-53e6-4d8e-bcf7-ee9b9d6e3a04 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.838721 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2b77e-15d7-4e47-83ea-87c35bc4fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.839343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b77e-15d7-4e47-83ea-87c35bc4fc60 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.839616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b77e-15d7-4e47-83ea-87c35bc4fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.839933 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b77e-15d7-4e47-83ea-87c35bc4fc60 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.840608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2b77e-15d7-4e47-83ea-87c35bc4fc60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:55.840954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2b77e-15d7-4e47-83ea-87c35bc4fc60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:55.842350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2b77e-15d7-4e47-83ea-87c35bc4fc60 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:55.852110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 154/306] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:55.857679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2b77e-15d7-4e47-83ea-87c35bc4fc60 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.947866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa3c8f-53e6-4d8e-bcf7-ee9b9d6e3a04 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.972695 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:55.983245 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2b77e-15d7-4e47-83ea-87c35bc4fc60 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.985283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ffcfd-3c8e-4d39-9a1f-1db3c8b466ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.986029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ffcfd-3c8e-4d39-9a1f-1db3c8b466ae None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.986304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ffcfd-3c8e-4d39-9a1f-1db3c8b466ae None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.986573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ffcfd-3c8e-4d39-9a1f-1db3c8b466ae None admin] PATH_INFO: `/v3/users/e7651b2c7bce4b2d9d9d1e1e2b127ee2` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.002773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ffcfd-3c8e-4d39-9a1f-1db3c8b466ae None admin] RBAC: Authorizing `identity:get_user(user_id=e7651b2c7bce4b2d9d9d1e1e2b127ee2)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:56.004237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ffcfd-3c8e-4d39-9a1f-1db3c8b466ae None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:56.006094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 153/307] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/users/e7651b2c7bce4b2d9d9d1e1e2b127ee2 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:56.011739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ffcfd-3c8e-4d39-9a1f-1db3c8b466ae None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.019879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:56.032227 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b07b8-c509-48a3-b63b-4857d3bb15f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.033259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b07b8-c509-48a3-b63b-4857d3bb15f0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.033631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b07b8-c509-48a3-b63b-4857d3bb15f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.034014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b07b8-c509-48a3-b63b-4857d3bb15f0 None admin] PATH_INFO: `/v3/users/7626cbdbef0642638a837644f0683c55` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.035917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b07b8-c509-48a3-b63b-4857d3bb15f0 None admin] RBAC: Authorizing `identity:get_user(user_id=7626cbdbef0642638a837644f0683c55)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:56.037567 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b07b8-c509-48a3-b63b-4857d3bb15f0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:56.039930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 155/308] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/users/7626cbdbef0642638a837644f0683c55 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:56.045648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b07b8-c509-48a3-b63b-4857d3bb15f0 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.121733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ffcfd-3c8e-4d39-9a1f-1db3c8b466ae None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:56.158470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2cfa7-89e0-49b6-820f-c67bf8fcf8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.159365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b07b8-c509-48a3-b63b-4857d3bb15f0 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:56.159984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2cfa7-89e0-49b6-820f-c67bf8fcf8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.160464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2cfa7-89e0-49b6-820f-c67bf8fcf8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.161103 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2cfa7-89e0-49b6-820f-c67bf8fcf8e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.162038 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2cfa7-89e0-49b6-820f-c67bf8fcf8e8 None admin] RBAC: Adding query filter params (role.id=907e76e063c343839d29a28f402e588b, user.id=e7651b2c7bce4b2d9d9d1e1e2b127ee2, scope.system=all) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:56.162539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2cfa7-89e0-49b6-820f-c67bf8fcf8e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:56.164169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2cfa7-89e0-49b6-820f-c67bf8fcf8e8 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:56.169994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 154/309] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Aug 9 12:08:56 2022] GET /identity/v3/role_assignments?user.id=e7651b2c7bce4b2d9d9d1e1e2b127ee2&scope.system=all&role.id=907e76e063c343839d29a28f402e588b => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:56.206768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdb2b9-876a-425b-8288-f1dfcdae0a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.207361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdb2b9-876a-425b-8288-f1dfcdae0a66 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.207642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdb2b9-876a-425b-8288-f1dfcdae0a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.207917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdb2b9-876a-425b-8288-f1dfcdae0a66 None admin] PATH_INFO: `/v3/system/users/7626cbdbef0642638a837644f0683c55/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.209432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdb2b9-876a-425b-8288-f1dfcdae0a66 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7626cbdbef0642638a837644f0683c55, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:56.211075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdb2b9-876a-425b-8288-f1dfcdae0a66 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:56.215614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac87f-ca41-411f-94d3-343ec5f8d539 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.215905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac87f-ca41-411f-94d3-343ec5f8d539 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.216170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac87f-ca41-411f-94d3-343ec5f8d539 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.217773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 155/310] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:56.224287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f19b9-50a1-45dc-907f-b6a5008feace None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.224820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 156/311] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Aug 9 12:08:56 2022] PUT /identity/v3/system/users/7626cbdbef0642638a837644f0683c55/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:08:56.224955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f19b9-50a1-45dc-907f-b6a5008feace None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.225337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f19b9-50a1-45dc-907f-b6a5008feace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.249200 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-700f19b9-50a1-45dc-907f-b6a5008feace None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:56.251347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-700f19b9-50a1-45dc-907f-b6a5008feace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:56.303988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:56.335648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 156/312] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:56.359182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdb2b9-876a-425b-8288-f1dfcdae0a66 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.428033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:56.474982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdb2b9-876a-425b-8288-f1dfcdae0a66 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:56.510030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114877c-8dab-45c1-a604-f9271b28b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.510916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114877c-8dab-45c1-a604-f9271b28b8ba None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.511339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114877c-8dab-45c1-a604-f9271b28b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.511802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114877c-8dab-45c1-a604-f9271b28b8ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.523531 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114877c-8dab-45c1-a604-f9271b28b8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-8114877c-8dab-45c1-a604-f9271b28b8ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:56.528974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:56.530031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:56.531673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:56.533684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 157/313] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:56.541458 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f19b9-50a1-45dc-907f-b6a5008feace None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.644382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f19b9-50a1-45dc-907f-b6a5008feace None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:56.680981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3f374-5826-4159-a3fd-6f48471b713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.681588 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3f374-5826-4159-a3fd-6f48471b713a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.681863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3f374-5826-4159-a3fd-6f48471b713a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.682131 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3f374-5826-4159-a3fd-6f48471b713a None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.682789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3f374-5826-4159-a3fd-6f48471b713a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:56.683086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3f374-5826-4159-a3fd-6f48471b713a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:56.684471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3f374-5826-4159-a3fd-6f48471b713a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:56.693827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 157/314] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:56.699442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114877c-8dab-45c1-a604-f9271b28b8ba None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.803504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114877c-8dab-45c1-a604-f9271b28b8ba None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:56.827164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:56.838991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033e0a6-ac5b-4b82-ac6b-cf252b13127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.839630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033e0a6-ac5b-4b82-ac6b-cf252b13127f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.839915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033e0a6-ac5b-4b82-ac6b-cf252b13127f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.840180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033e0a6-ac5b-4b82-ac6b-cf252b13127f None admin] PATH_INFO: `/v3/users/e65aa366ccca4805abd94cba60b877ab` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.841350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033e0a6-ac5b-4b82-ac6b-cf252b13127f None admin] RBAC: Authorizing `identity:get_user(user_id=e65aa366ccca4805abd94cba60b877ab)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:56.842805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033e0a6-ac5b-4b82-ac6b-cf252b13127f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:56.845535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 158/315] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:56 2022] GET /identity/v3/users/e65aa366ccca4805abd94cba60b877ab => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:56.851036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3f374-5826-4159-a3fd-6f48471b713a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.899594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:56.966504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3f374-5826-4159-a3fd-6f48471b713a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.001760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24b2cd-74b1-48b5-8df8-ec345aad570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.002421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24b2cd-74b1-48b5-8df8-ec345aad570f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.002701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24b2cd-74b1-48b5-8df8-ec345aad570f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.002976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24b2cd-74b1-48b5-8df8-ec345aad570f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.074966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24b2cd-74b1-48b5-8df8-ec345aad570f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.076354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24b2cd-74b1-48b5-8df8-ec345aad570f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.115792 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:57.178609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 158/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:57.184293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033e0a6-ac5b-4b82-ac6b-cf252b13127f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.288473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033e0a6-ac5b-4b82-ac6b-cf252b13127f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.323643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d366-3641-4d5c-8d7c-48ccb59d1027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.324325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d366-3641-4d5c-8d7c-48ccb59d1027 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.324601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d366-3641-4d5c-8d7c-48ccb59d1027 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.324895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d366-3641-4d5c-8d7c-48ccb59d1027 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.326072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d366-3641-4d5c-8d7c-48ccb59d1027 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.327987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d366-3641-4d5c-8d7c-48ccb59d1027 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.329875 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 159/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:57.335971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24b2cd-74b1-48b5-8df8-ec345aad570f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.443716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24b2cd-74b1-48b5-8df8-ec345aad570f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.479799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f466b7-fa4b-4430-ae68-cf99c4f75517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.480429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f466b7-fa4b-4430-ae68-cf99c4f75517 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.480734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f466b7-fa4b-4430-ae68-cf99c4f75517 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.481004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f466b7-fa4b-4430-ae68-cf99c4f75517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.481746 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f466b7-fa4b-4430-ae68-cf99c4f75517 None admin] RBAC: Adding query filter params (role.id=907e76e063c343839d29a28f402e588b, scope.project.id=fe25744415024ccba84b98723af57001, user.id=e65aa366ccca4805abd94cba60b877ab) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:57.482052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f466b7-fa4b-4430-ae68-cf99c4f75517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.483586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f466b7-fa4b-4430-ae68-cf99c4f75517 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.491171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 159/318] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/role_assignments?user.id=e65aa366ccca4805abd94cba60b877ab&scope.project.id=fe25744415024ccba84b98723af57001&role.id=907e76e063c343839d29a28f402e588b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:57.854508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359b7c6-8558-4217-af8c-b0fc2377a81c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.854910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359b7c6-8558-4217-af8c-b0fc2377a81c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.855092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359b7c6-8558-4217-af8c-b0fc2377a81c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.856544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 160/319] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:57.861703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ed0d9-c6a7-4b2f-af53-fbc1d43dd5eb None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.861990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ed0d9-c6a7-4b2f-af53-fbc1d43dd5eb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.862262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ed0d9-c6a7-4b2f-af53-fbc1d43dd5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.868524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:57.881801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-cf1ed0d9-c6a7-4b2f-af53-fbc1d43dd5eb None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:57.882983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-cf1ed0d9-c6a7-4b2f-af53-fbc1d43dd5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:57.953069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 160/320] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:57.974466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359b7c6-8558-4217-af8c-b0fc2377a81c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.035537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:58.081179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359b7c6-8558-4217-af8c-b0fc2377a81c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.114472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb14071-c49e-40fc-980a-19153186ece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.115096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb14071-c49e-40fc-980a-19153186ece8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.115365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb14071-c49e-40fc-980a-19153186ece8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.115625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb14071-c49e-40fc-980a-19153186ece8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.116718 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb14071-c49e-40fc-980a-19153186ece8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.118144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb14071-c49e-40fc-980a-19153186ece8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.119930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 161/321] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:58.126088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ed0d9-c6a7-4b2f-af53-fbc1d43dd5eb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.224597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ed0d9-c6a7-4b2f-af53-fbc1d43dd5eb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.254676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:58.260509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f444433-132e-4b8b-ab18-2f8927963f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.261148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444433-132e-4b8b-ab18-2f8927963f1f None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.261419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444433-132e-4b8b-ab18-2f8927963f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.261681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444433-132e-4b8b-ab18-2f8927963f1f None admin] PATH_INFO: `/v3/groups` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.262305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f444433-132e-4b8b-ab18-2f8927963f1f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.263748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f444433-132e-4b8b-ab18-2f8927963f1f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.276386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336a0fa-e873-4057-a379-b715fdab504b None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.276950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336a0fa-e873-4057-a379-b715fdab504b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.277154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336a0fa-e873-4057-a379-b715fdab504b None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.278600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 162/322] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:58.283560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34df6c-3de5-42d2-a5ea-b903c27b063e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.283844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34df6c-3de5-42d2-a5ea-b903c27b063e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.284115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34df6c-3de5-42d2-a5ea-b903c27b063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.292856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 161/323] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Aug 9 12:08:58 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:58.310190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0b34df6c-3de5-42d2-a5ea-b903c27b063e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:58.311665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0b34df6c-3de5-42d2-a5ea-b903c27b063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:58.385694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 163/324] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:58.406123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f70fb3-a65d-4a64-9f70-79e5ccfe4766 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.406658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f70fb3-a65d-4a64-9f70-79e5ccfe4766 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.406731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f70fb3-a65d-4a64-9f70-79e5ccfe4766 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.408264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 162/325] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:58.408369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34df6c-3de5-42d2-a5ea-b903c27b063e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.413818 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc28a2-b5c9-4549-9f6b-c23fed7155a2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.417180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc28a2-b5c9-4549-9f6b-c23fed7155a2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.417180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc28a2-b5c9-4549-9f6b-c23fed7155a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.434047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-e2fc28a2-b5c9-4549-9f6b-c23fed7155a2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:58.435252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e2fc28a2-b5c9-4549-9f6b-c23fed7155a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:58.476053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:58.525078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 163/326] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:58.532788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34df6c-3de5-42d2-a5ea-b903c27b063e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.549221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc28a2-b5c9-4549-9f6b-c23fed7155a2 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.576071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba97a-5b2a-4200-a7a9-8d13f067a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.576738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba97a-5b2a-4200-a7a9-8d13f067a021 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.577015 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba97a-5b2a-4200-a7a9-8d13f067a021 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.577282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba97a-5b2a-4200-a7a9-8d13f067a021 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.594924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ba97a-5b2a-4200-a7a9-8d13f067a021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-0b8ba97a-5b2a-4200-a7a9-8d13f067a021 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:58.599678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:58.600570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:58.601515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:08:58.602246 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 164/327] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:58.609074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba97a-5b2a-4200-a7a9-8d13f067a021 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.682272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc28a2-b5c9-4549-9f6b-c23fed7155a2 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.714409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:58.728194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11bd8a-4671-4801-95bd-7e8893148496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.728857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11bd8a-4671-4801-95bd-7e8893148496 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.729121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11bd8a-4671-4801-95bd-7e8893148496 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.729380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11bd8a-4671-4801-95bd-7e8893148496 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.741732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba97a-5b2a-4200-a7a9-8d13f067a021 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.744364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11bd8a-4671-4801-95bd-7e8893148496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-5c11bd8a-4671-4801-95bd-7e8893148496 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:58.749082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:58.750625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:08:58.751413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 164/328] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:58.756740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11bd8a-4671-4801-95bd-7e8893148496 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.771798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:58.801299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397c68-9148-4b38-bdf2-e9bebfab8115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.802057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397c68-9148-4b38-bdf2-e9bebfab8115 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.802435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397c68-9148-4b38-bdf2-e9bebfab8115 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.803615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397c68-9148-4b38-bdf2-e9bebfab8115 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.803615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397c68-9148-4b38-bdf2-e9bebfab8115 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:58.803913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397c68-9148-4b38-bdf2-e9bebfab8115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.805429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397c68-9148-4b38-bdf2-e9bebfab8115 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.817970 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 165/329] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:58.824166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397c68-9148-4b38-bdf2-e9bebfab8115 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11bd8a-4671-4801-95bd-7e8893148496 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.934122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f719301-bbd8-4df9-b1ea-2602744c2b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.934651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f719301-bbd8-4df9-b1ea-2602744c2b35 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.934925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f719301-bbd8-4df9-b1ea-2602744c2b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.935193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f719301-bbd8-4df9-b1ea-2602744c2b35 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.935856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f719301-bbd8-4df9-b1ea-2602744c2b35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:58.936156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f719301-bbd8-4df9-b1ea-2602744c2b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.937622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f719301-bbd8-4df9-b1ea-2602744c2b35 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.949331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 165/330] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:58.955661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f719301-bbd8-4df9-b1ea-2602744c2b35 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.957600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397c68-9148-4b38-bdf2-e9bebfab8115 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:59.005819 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b0d0e-29d7-4a5f-b751-810d4b63718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:59.006858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b0d0e-29d7-4a5f-b751-810d4b63718b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.007414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b0d0e-29d7-4a5f-b751-810d4b63718b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.007701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b0d0e-29d7-4a5f-b751-810d4b63718b None admin] PATH_INFO: `/v3/users/e7651b2c7bce4b2d9d9d1e1e2b127ee2` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:59.009210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:59.009740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b0d0e-29d7-4a5f-b751-810d4b63718b None admin] RBAC: Authorizing `identity:get_user(user_id=e7651b2c7bce4b2d9d9d1e1e2b127ee2)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:59.011223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b0d0e-29d7-4a5f-b751-810d4b63718b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:59.013343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 166/331] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:58 2022] GET /identity/v3/users/e7651b2c7bce4b2d9d9d1e1e2b127ee2 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:59.019286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b0d0e-29d7-4a5f-b751-810d4b63718b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:59.081934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:59.092146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f719301-bbd8-4df9-b1ea-2602744c2b35 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:59.129714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f5872-99a8-47d8-8450-bfa26b2fc420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:59.130350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f5872-99a8-47d8-8450-bfa26b2fc420 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.130727 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f5872-99a8-47d8-8450-bfa26b2fc420 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.131010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f5872-99a8-47d8-8450-bfa26b2fc420 None admin] PATH_INFO: `/v3/users/7626cbdbef0642638a837644f0683c55` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:59.132148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f5872-99a8-47d8-8450-bfa26b2fc420 None admin] RBAC: Authorizing `identity:get_user(user_id=7626cbdbef0642638a837644f0683c55)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:59.134962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f5872-99a8-47d8-8450-bfa26b2fc420 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:59.136954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 166/332] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:58 2022] GET /identity/v3/users/7626cbdbef0642638a837644f0683c55 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:59.142719 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f5872-99a8-47d8-8450-bfa26b2fc420 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:59.143668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b0d0e-29d7-4a5f-b751-810d4b63718b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:59.183085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbde618-b7be-477a-b62f-a2da89ec56c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:59.184038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde618-b7be-477a-b62f-a2da89ec56c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.184439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde618-b7be-477a-b62f-a2da89ec56c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.184883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde618-b7be-477a-b62f-a2da89ec56c6 None admin] PATH_INFO: `/v3/system/users/e7651b2c7bce4b2d9d9d1e1e2b127ee2/roles/907e76e063c343839d29a28f402e588b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:59.186450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbde618-b7be-477a-b62f-a2da89ec56c6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e7651b2c7bce4b2d9d9d1e1e2b127ee2, role_id=907e76e063c343839d29a28f402e588b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:59.188259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbde618-b7be-477a-b62f-a2da89ec56c6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:59.198092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 167/333] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Aug 9 12:08:59 2022] PUT /identity/v3/system/users/e7651b2c7bce4b2d9d9d1e1e2b127ee2/roles/907e76e063c343839d29a28f402e588b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:08:59.256914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f5872-99a8-47d8-8450-bfa26b2fc420 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:59.271606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:59.295445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e0bdd-c01d-446a-91f3-fa2d986a4ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:59.296071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e0bdd-c01d-446a-91f3-fa2d986a4ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.296996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e0bdd-c01d-446a-91f3-fa2d986a4ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.297272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e0bdd-c01d-446a-91f3-fa2d986a4ba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:59.298268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e0bdd-c01d-446a-91f3-fa2d986a4ba9 None admin] RBAC: Adding query filter params (role.id=12dc9c7d75da4722bf4525a56eea0e47, user.id=7626cbdbef0642638a837644f0683c55, scope.system=all) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:59.298578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e0bdd-c01d-446a-91f3-fa2d986a4ba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:59.300161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e0bdd-c01d-446a-91f3-fa2d986a4ba9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:59.314459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 167/334] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Aug 9 12:08:59 2022] GET /identity/v3/role_assignments?user.id=7626cbdbef0642638a837644f0683c55&scope.system=all&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:00.739927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ff299-9f57-4c42-a13d-fd475c2b6cd0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:00.740406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ff299-9f57-4c42-a13d-fd475c2b6cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:00.740406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ff299-9f57-4c42-a13d-fd475c2b6cd0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:00.742113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 168/335] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:00.747333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e06f0-d8ae-42e1-83b5-fb549cdcfc2f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:00.747740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e06f0-d8ae-42e1-83b5-fb549cdcfc2f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:00.747906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e06f0-d8ae-42e1-83b5-fb549cdcfc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:00.770396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-054e06f0-d8ae-42e1-83b5-fb549cdcfc2f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:00.771663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-054e06f0-d8ae-42e1-83b5-fb549cdcfc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:00.857621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 168/336] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:00.893391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ff299-9f57-4c42-a13d-fd475c2b6cd0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:01.025611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ff299-9f57-4c42-a13d-fd475c2b6cd0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:01.042513 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:01.075470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea57283-7d69-4eba-850f-ca41585ec616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:01.076106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea57283-7d69-4eba-850f-ca41585ec616 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:01.076386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea57283-7d69-4eba-850f-ca41585ec616 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:01.076678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea57283-7d69-4eba-850f-ca41585ec616 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:01.097616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea57283-7d69-4eba-850f-ca41585ec616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7ea57283-7d69-4eba-850f-ca41585ec616 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:01.102374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:01.103240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:01.104114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 169/337] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:01.111652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e06f0-d8ae-42e1-83b5-fb549cdcfc2f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:01.248984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e06f0-d8ae-42e1-83b5-fb549cdcfc2f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:01.253043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:01.293980 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ced239-1754-4e9d-90e9-05931b5137aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:01.294517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ced239-1754-4e9d-90e9-05931b5137aa None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:01.294858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ced239-1754-4e9d-90e9-05931b5137aa None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:01.295135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ced239-1754-4e9d-90e9-05931b5137aa None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:01.295805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ced239-1754-4e9d-90e9-05931b5137aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:01.296133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ced239-1754-4e9d-90e9-05931b5137aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:01.298366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ced239-1754-4e9d-90e9-05931b5137aa None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:01.311670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 169/338] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:01.317810 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea57283-7d69-4eba-850f-ca41585ec616 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:01.433091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2841726-af34-4188-84f0-e003eee2fa58 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:01.433371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2841726-af34-4188-84f0-e003eee2fa58 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:01.433834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2841726-af34-4188-84f0-e003eee2fa58 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:01.435688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 170/339] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:01.441999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9123bc9-a313-406a-a905-f3bbb03176a4 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:01.442277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9123bc9-a313-406a-a905-f3bbb03176a4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:01.442541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9123bc9-a313-406a-a905-f3bbb03176a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:01.475006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c9123bc9-a313-406a-a905-f3bbb03176a4 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:01.476386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c9123bc9-a313-406a-a905-f3bbb03176a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:01.492385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea57283-7d69-4eba-850f-ca41585ec616 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:01.544696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedd033-a2f7-48e4-bace-a12645e2aa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:01.545242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedd033-a2f7-48e4-bace-a12645e2aa5e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:01.545521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedd033-a2f7-48e4-bace-a12645e2aa5e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:01.545790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedd033-a2f7-48e4-bace-a12645e2aa5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:01.609084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:01.646410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedd033-a2f7-48e4-bace-a12645e2aa5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:01.648160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedd033-a2f7-48e4-bace-a12645e2aa5e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:01.674566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 171/340] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:01.713776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9123bc9-a313-406a-a905-f3bbb03176a4 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:01.786166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 170/341] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:01.786166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421c1b-b3ec-45eb-8475-c1304af0f51e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:01.786166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421c1b-b3ec-45eb-8475-c1304af0f51e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:01.786166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421c1b-b3ec-45eb-8475-c1304af0f51e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:01.786851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 171/342] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:01.791917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421c1b-b3ec-45eb-8475-c1304af0f51e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:01.891318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:01.906976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9123bc9-a313-406a-a905-f3bbb03176a4 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:01.924986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:01.957880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168249e-bfaa-414a-a76d-f31c038cd09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:01.958525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168249e-bfaa-414a-a76d-f31c038cd09a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:01.958801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168249e-bfaa-414a-a76d-f31c038cd09a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:01.959070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168249e-bfaa-414a-a76d-f31c038cd09a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:01.982137 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168249e-bfaa-414a-a76d-f31c038cd09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:01.983445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421c1b-b3ec-45eb-8475-c1304af0f51e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-7168249e-bfaa-414a-a76d-f31c038cd09a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:01.995306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:01.996212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:01.997034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 172/343] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:02.000041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4debe1b-b26a-4ede-9188-c612ef8efb18 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.003774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4debe1b-b26a-4ede-9188-c612ef8efb18 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.003774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4debe1b-b26a-4ede-9188-c612ef8efb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.041561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a4debe1b-b26a-4ede-9188-c612ef8efb18 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:02.042775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a4debe1b-b26a-4ede-9188-c612ef8efb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:02.060043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d5632-6efd-4a06-b66a-e8f4f4552e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.061055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d5632-6efd-4a06-b66a-e8f4f4552e84 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.061333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d5632-6efd-4a06-b66a-e8f4f4552e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.061625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d5632-6efd-4a06-b66a-e8f4f4552e84 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.065790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d5632-6efd-4a06-b66a-e8f4f4552e84 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:02.067336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d5632-6efd-4a06-b66a-e8f4f4552e84 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:02.072966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 172/344] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:01 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:02.073755 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d5632-6efd-4a06-b66a-e8f4f4552e84 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.177546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 173/345] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:02.178255 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4debe1b-b26a-4ede-9188-c612ef8efb18 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.227896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d5632-6efd-4a06-b66a-e8f4f4552e84 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.272117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3f025-8df4-46a9-871a-c622600339eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.272753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3f025-8df4-46a9-871a-c622600339eb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.273032 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3f025-8df4-46a9-871a-c622600339eb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.273299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3f025-8df4-46a9-871a-c622600339eb None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.273964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3f025-8df4-46a9-871a-c622600339eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:02.274261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3f025-8df4-46a9-871a-c622600339eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:02.275636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3f025-8df4-46a9-871a-c622600339eb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:02.281644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:02.290832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:02.291018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 173/346] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:02.291018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab996f-5d93-445f-971a-cf0d3bac7818 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.291018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab996f-5d93-445f-971a-cf0d3bac7818 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.291018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab996f-5d93-445f-971a-cf0d3bac7818 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.291594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 174/347] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:02.292019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab996f-5d93-445f-971a-cf0d3bac7818 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.316012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4debe1b-b26a-4ede-9188-c612ef8efb18 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.355269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f5018-1650-40ba-98bb-3c24e72570e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.356270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f5018-1650-40ba-98bb-3c24e72570e3 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.356778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f5018-1650-40ba-98bb-3c24e72570e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.357245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f5018-1650-40ba-98bb-3c24e72570e3 None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.366239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f5018-1650-40ba-98bb-3c24e72570e3 None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:02.367997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f5018-1650-40ba-98bb-3c24e72570e3 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:02.369901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 174/348] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:02.370852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f5018-1650-40ba-98bb-3c24e72570e3 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.409368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab996f-5d93-445f-971a-cf0d3bac7818 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.453062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e75479-8752-4bbb-86ca-a8dabe875700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.453948 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e75479-8752-4bbb-86ca-a8dabe875700 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.454402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e75479-8752-4bbb-86ca-a8dabe875700 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.454846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e75479-8752-4bbb-86ca-a8dabe875700 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.468580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e75479-8752-4bbb-86ca-a8dabe875700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a9e75479-8752-4bbb-86ca-a8dabe875700 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:02.474554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:02.475427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:02.476230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 175/349] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:02.477588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db7b28-da1c-42d3-9acc-5a27c9bd27f9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.477588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db7b28-da1c-42d3-9acc-5a27c9bd27f9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.477748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db7b28-da1c-42d3-9acc-5a27c9bd27f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.497233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e4db7b28-da1c-42d3-9acc-5a27c9bd27f9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:02.497963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f5018-1650-40ba-98bb-3c24e72570e3 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.498418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e4db7b28-da1c-42d3-9acc-5a27c9bd27f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:02.544707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c7f29-d238-419c-8514-4ef81c062f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.545686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c7f29-d238-419c-8514-4ef81c062f2e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.546060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c7f29-d238-419c-8514-4ef81c062f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.547064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c7f29-d238-419c-8514-4ef81c062f2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.567175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:02.570370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:02.587787 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 176/350] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:02.589040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db7b28-da1c-42d3-9acc-5a27c9bd27f9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.635763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c7f29-d238-419c-8514-4ef81c062f2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:02.637329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c7f29-d238-419c-8514-4ef81c062f2e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:02.722693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db7b28-da1c-42d3-9acc-5a27c9bd27f9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.763801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d3a05-03ee-447e-bf8f-bdead495cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.764409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d3a05-03ee-447e-bf8f-bdead495cd19 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.764730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d3a05-03ee-447e-bf8f-bdead495cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.765051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d3a05-03ee-447e-bf8f-bdead495cd19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.765776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d3a05-03ee-447e-bf8f-bdead495cd19 None admin] RBAC: Adding query filter params (group.id=eae44bf46daa4b719d95ab55b7afcee0, role.id=12dc9c7d75da4722bf4525a56eea0e47, scope.project.id=bd32494f9acf41b2af293e24ff51e99a) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:02.766080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d3a05-03ee-447e-bf8f-bdead495cd19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:02.767507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d3a05-03ee-447e-bf8f-bdead495cd19 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:02.772301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 175/351] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:02.773881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563fdc2-87f7-43d6-8017-34b850f9acab None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.774565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 177/352] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/role_assignments?group.id=eae44bf46daa4b719d95ab55b7afcee0&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:02.774801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563fdc2-87f7-43d6-8017-34b850f9acab None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.775231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d3a05-03ee-447e-bf8f-bdead495cd19 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.775462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563fdc2-87f7-43d6-8017-34b850f9acab None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.777127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 176/353] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:02.778124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563fdc2-87f7-43d6-8017-34b850f9acab None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.845623 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:02.854375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:02.905020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d3a05-03ee-447e-bf8f-bdead495cd19 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.934405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563fdc2-87f7-43d6-8017-34b850f9acab None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.944147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807431c-cdb8-4160-b298-9269be6f462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.944790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807431c-cdb8-4160-b298-9269be6f462e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.945076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807431c-cdb8-4160-b298-9269be6f462e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.945762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807431c-cdb8-4160-b298-9269be6f462e None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.946008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807431c-cdb8-4160-b298-9269be6f462e None admin] RBAC: Adding query filter params (name=member) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:02.946313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807431c-cdb8-4160-b298-9269be6f462e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:02.947698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807431c-cdb8-4160-b298-9269be6f462e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:02.958839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 178/354] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:02.960178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932660b9-c383-4162-a219-a27161140dfe None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.960459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932660b9-c383-4162-a219-a27161140dfe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.963844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932660b9-c383-4162-a219-a27161140dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.980371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-932660b9-c383-4162-a219-a27161140dfe None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:02.981696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-932660b9-c383-4162-a219-a27161140dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:02.984748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9ac21-90c3-45d2-9460-748ccc2f986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.985681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9ac21-90c3-45d2-9460-748ccc2f986d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.986157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9ac21-90c3-45d2-9460-748ccc2f986d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.986661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9ac21-90c3-45d2-9460-748ccc2f986d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.998253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9ac21-90c3-45d2-9460-748ccc2f986d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-cab9ac21-90c3-45d2-9460-748ccc2f986d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:03.004209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:03.005328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:03.006095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:03.008282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 177/355] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:03.009307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9ac21-90c3-45d2-9460-748ccc2f986d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.060161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 179/356] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:03.065865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932660b9-c383-4162-a219-a27161140dfe None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.121387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9ac21-90c3-45d2-9460-748ccc2f986d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.130075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.134675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.161937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5848525-f0fe-47f2-b61d-b3e6a3f6b5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.162954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5848525-f0fe-47f2-b61d-b3e6a3f6b5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.163429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5848525-f0fe-47f2-b61d-b3e6a3f6b5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.164747 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5848525-f0fe-47f2-b61d-b3e6a3f6b5e6 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.166116 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5848525-f0fe-47f2-b61d-b3e6a3f6b5e6 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.167796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5848525-f0fe-47f2-b61d-b3e6a3f6b5e6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.170057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 178/357] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:03.171176 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5848525-f0fe-47f2-b61d-b3e6a3f6b5e6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.194906 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932660b9-c383-4162-a219-a27161140dfe None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.231809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1b833-213d-4d6a-b716-7fd0665afefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.232392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1b833-213d-4d6a-b716-7fd0665afefe None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.232742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1b833-213d-4d6a-b716-7fd0665afefe None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.232993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1b833-213d-4d6a-b716-7fd0665afefe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.282885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5848525-f0fe-47f2-b61d-b3e6a3f6b5e6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.310949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1b833-213d-4d6a-b716-7fd0665afefe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.312519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1b833-213d-4d6a-b716-7fd0665afefe None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.322117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652b60-d5e4-4b9f-b980-3694f6093062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.323059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652b60-d5e4-4b9f-b980-3694f6093062 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.323531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652b60-d5e4-4b9f-b980-3694f6093062 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.324019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652b60-d5e4-4b9f-b980-3694f6093062 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.324924 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25652b60-d5e4-4b9f-b980-3694f6093062 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:03.325422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25652b60-d5e4-4b9f-b980-3694f6093062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.326984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25652b60-d5e4-4b9f-b980-3694f6093062 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.338091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 179/358] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:03.339216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652b60-d5e4-4b9f-b980-3694f6093062 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.377583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.393072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.444751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 180/359] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:03.446050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1b833-213d-4d6a-b716-7fd0665afefe None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.460172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652b60-d5e4-4b9f-b980-3694f6093062 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.501398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0fb1-c0b2-4a20-9806-ed47c33cb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.501950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0fb1-c0b2-4a20-9806-ed47c33cb111 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.502919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0fb1-c0b2-4a20-9806-ed47c33cb111 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.502919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0fb1-c0b2-4a20-9806-ed47c33cb111 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.514317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d0fb1-c0b2-4a20-9806-ed47c33cb111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-532d0fb1-c0b2-4a20-9806-ed47c33cb111 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:03.520119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:03.521073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:03.521884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 180/360] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:03.522551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0fb1-c0b2-4a20-9806-ed47c33cb111 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.580391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1b833-213d-4d6a-b716-7fd0665afefe None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.625031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f349a3-0cfc-49eb-9567-bca7e4171fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.626218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f349a3-0cfc-49eb-9567-bca7e4171fad None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.626683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f349a3-0cfc-49eb-9567-bca7e4171fad None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.627278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f349a3-0cfc-49eb-9567-bca7e4171fad None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.629039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f349a3-0cfc-49eb-9567-bca7e4171fad None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.630951 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f349a3-0cfc-49eb-9567-bca7e4171fad None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.633364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 181/361] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:03.634680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d36f-9002-43e4-a5a9-0fe37957d2a4 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.635135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d36f-9002-43e4-a5a9-0fe37957d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.636053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d36f-9002-43e4-a5a9-0fe37957d2a4 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.637794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 182/362] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:03.638853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d36f-9002-43e4-a5a9-0fe37957d2a4 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.644530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.650370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0fb1-c0b2-4a20-9806-ed47c33cb111 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.659819 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.703839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a677fe5-77bf-4080-b58e-bdf18e5332a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.704482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a677fe5-77bf-4080-b58e-bdf18e5332a7 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.704782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a677fe5-77bf-4080-b58e-bdf18e5332a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.705048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a677fe5-77bf-4080-b58e-bdf18e5332a7 None admin] PATH_INFO: `/v3/users/e7651b2c7bce4b2d9d9d1e1e2b127ee2` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.706277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a677fe5-77bf-4080-b58e-bdf18e5332a7 None admin] RBAC: Authorizing `identity:get_user(user_id=e7651b2c7bce4b2d9d9d1e1e2b127ee2)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.707952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a677fe5-77bf-4080-b58e-bdf18e5332a7 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.710126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 181/363] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/users/e7651b2c7bce4b2d9d9d1e1e2b127ee2 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:03.711124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a677fe5-77bf-4080-b58e-bdf18e5332a7 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.789761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d36f-9002-43e4-a5a9-0fe37957d2a4 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.828383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ff395-9a6d-4aa2-9959-24d5e8c43a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.829416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ff395-9a6d-4aa2-9959-24d5e8c43a23 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.829882 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ff395-9a6d-4aa2-9959-24d5e8c43a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.830340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ff395-9a6d-4aa2-9959-24d5e8c43a23 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.831906 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ff395-9a6d-4aa2-9959-24d5e8c43a23 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.833700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ff395-9a6d-4aa2-9959-24d5e8c43a23 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.836037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 183/364] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:03.837041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ff395-9a6d-4aa2-9959-24d5e8c43a23 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.841686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a677fe5-77bf-4080-b58e-bdf18e5332a7 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.893547 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970f91f-39ba-4da6-bd66-7d89c7aa3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.894283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f91f-39ba-4da6-bd66-7d89c7aa3379 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.894658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f91f-39ba-4da6-bd66-7d89c7aa3379 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.895022 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f91f-39ba-4da6-bd66-7d89c7aa3379 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.895925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970f91f-39ba-4da6-bd66-7d89c7aa3379 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:03.896317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970f91f-39ba-4da6-bd66-7d89c7aa3379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.897925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970f91f-39ba-4da6-bd66-7d89c7aa3379 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.911338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 182/365] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:03.916699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd8d3-174d-4f72-a0dd-93d83beb62f8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.917044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd8d3-174d-4f72-a0dd-93d83beb62f8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.917324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd8d3-174d-4f72-a0dd-93d83beb62f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.939369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-587cd8d3-174d-4f72-a0dd-93d83beb62f8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:03.940699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-587cd8d3-174d-4f72-a0dd-93d83beb62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:03.941338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.967260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.972022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ff395-9a6d-4aa2-9959-24d5e8c43a23 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.024427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5469b9-4fc5-41c5-bc08-0571268f4fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.025224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5469b9-4fc5-41c5-bc08-0571268f4fea None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.025504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5469b9-4fc5-41c5-bc08-0571268f4fea None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.025777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5469b9-4fc5-41c5-bc08-0571268f4fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.026505 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5469b9-4fc5-41c5-bc08-0571268f4fea None admin] RBAC: Adding query filter params (group.id=eae44bf46daa4b719d95ab55b7afcee0, role.id=c6822f728eca477f81827dcc4c547bd0, scope.project.id=bd32494f9acf41b2af293e24ff51e99a) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:04.026812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5469b9-4fc5-41c5-bc08-0571268f4fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.028244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5469b9-4fc5-41c5-bc08-0571268f4fea None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.034832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 183/366] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:04.035532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cd8d3-174d-4f72-a0dd-93d83beb62f8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.037378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 184/367] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/role_assignments?group.id=eae44bf46daa4b719d95ab55b7afcee0&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=c6822f728eca477f81827dcc4c547bd0 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.038354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5469b9-4fc5-41c5-bc08-0571268f4fea None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.155353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5469b9-4fc5-41c5-bc08-0571268f4fea None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.179998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cd8d3-174d-4f72-a0dd-93d83beb62f8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.194336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf25b2-1203-4486-92d4-def1d46fc2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.194986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf25b2-1203-4486-92d4-def1d46fc2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.195277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf25b2-1203-4486-92d4-def1d46fc2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.195533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf25b2-1203-4486-92d4-def1d46fc2e5 None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.196714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf25b2-1203-4486-92d4-def1d46fc2e5 None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.198395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf25b2-1203-4486-92d4-def1d46fc2e5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.200445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 185/368] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.201456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf25b2-1203-4486-92d4-def1d46fc2e5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.220515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.224150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff5b35-f956-4d21-8f45-2e9639f26d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.225006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff5b35-f956-4d21-8f45-2e9639f26d4a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.225450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff5b35-f956-4d21-8f45-2e9639f26d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.225857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff5b35-f956-4d21-8f45-2e9639f26d4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.226838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff5b35-f956-4d21-8f45-2e9639f26d4a None admin] RBAC: Adding query filter params (role.id=907e76e063c343839d29a28f402e588b, user.id=e7651b2c7bce4b2d9d9d1e1e2b127ee2, scope.system=all) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:04.228210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff5b35-f956-4d21-8f45-2e9639f26d4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.229884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff5b35-f956-4d21-8f45-2e9639f26d4a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.249800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 184/369] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/role_assignments?user.id=e7651b2c7bce4b2d9d9d1e1e2b127ee2&scope.system=all&role.id=907e76e063c343839d29a28f402e588b => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.249995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff5b35-f956-4d21-8f45-2e9639f26d4a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.269891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.323848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf25b2-1203-4486-92d4-def1d46fc2e5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.364445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ff1b9-4391-41e1-b3b9-2e32032112de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.365286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ff1b9-4391-41e1-b3b9-2e32032112de None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.365661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ff1b9-4391-41e1-b3b9-2e32032112de None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.366028 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ff1b9-4391-41e1-b3b9-2e32032112de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.387115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff5b35-f956-4d21-8f45-2e9639f26d4a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.439137 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab687c7-c717-48a5-8e89-d83c61bafc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.439783 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab687c7-c717-48a5-8e89-d83c61bafc7e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.440064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab687c7-c717-48a5-8e89-d83c61bafc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.440336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab687c7-c717-48a5-8e89-d83c61bafc7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.455595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab687c7-c717-48a5-8e89-d83c61bafc7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-1ab687c7-c717-48a5-8e89-d83c61bafc7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:04.462084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:04.463010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:04.463778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:04.464396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 185/370] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:04.465262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab687c7-c717-48a5-8e89-d83c61bafc7e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.512160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ff1b9-4391-41e1-b3b9-2e32032112de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.516149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ff1b9-4391-41e1-b3b9-2e32032112de None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.535457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.563804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.587971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab687c7-c717-48a5-8e89-d83c61bafc7e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.623768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a8a50-fd4e-467c-9835-41fc354e220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.625329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a8a50-fd4e-467c-9835-41fc354e220c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.625718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a8a50-fd4e-467c-9835-41fc354e220c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.626086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a8a50-fd4e-467c-9835-41fc354e220c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.626936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a8a50-fd4e-467c-9835-41fc354e220c None admin] RBAC: Adding query filter params (group.id=eae44bf46daa4b719d95ab55b7afcee0, role.id=12dc9c7d75da4722bf4525a56eea0e47, scope.project.id=fe25744415024ccba84b98723af57001) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:04.627344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a8a50-fd4e-467c-9835-41fc354e220c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.628970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a8a50-fd4e-467c-9835-41fc354e220c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.635632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 186/371] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/role_assignments?group.id=eae44bf46daa4b719d95ab55b7afcee0&scope.project.id=fe25744415024ccba84b98723af57001&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.636475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a8a50-fd4e-467c-9835-41fc354e220c None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.636602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 186/372] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:04.646755 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ff1b9-4391-41e1-b3b9-2e32032112de None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.768877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a8a50-fd4e-467c-9835-41fc354e220c None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.812045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0f00c-ce95-4334-9ff0-b2b6b6a2e7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.812811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0f00c-ce95-4334-9ff0-b2b6b6a2e7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.813094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0f00c-ce95-4334-9ff0-b2b6b6a2e7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.813366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0f00c-ce95-4334-9ff0-b2b6b6a2e7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.815170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0f00c-ce95-4334-9ff0-b2b6b6a2e7a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:04.815572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0f00c-ce95-4334-9ff0-b2b6b6a2e7a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.817056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0f00c-ce95-4334-9ff0-b2b6b6a2e7a3 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.823771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.830864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 187/373] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.836149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0f00c-ce95-4334-9ff0-b2b6b6a2e7a3 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.881208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ff1b9-4391-41e1-b3b9-2e32032112de None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.901550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.924202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e055b8-397c-4701-9855-febd64866d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.925336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e055b8-397c-4701-9855-febd64866d97 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.925815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e055b8-397c-4701-9855-febd64866d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.926279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e055b8-397c-4701-9855-febd64866d97 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.927681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e055b8-397c-4701-9855-febd64866d97 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.929611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e055b8-397c-4701-9855-febd64866d97 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.931751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 187/374] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:04.937894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e055b8-397c-4701-9855-febd64866d97 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.059550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0f00c-ce95-4334-9ff0-b2b6b6a2e7a3 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.065650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e055b8-397c-4701-9855-febd64866d97 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.135282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837481c2-211f-4d60-8d0c-9b78f8c552c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.136645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837481c2-211f-4d60-8d0c-9b78f8c552c7 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.137638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837481c2-211f-4d60-8d0c-9b78f8c552c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.138435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e140e-893b-4304-b7ca-74d6e5be21d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.139611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e140e-893b-4304-b7ca-74d6e5be21d5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.140225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837481c2-211f-4d60-8d0c-9b78f8c552c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.141420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e140e-893b-4304-b7ca-74d6e5be21d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.141890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e140e-893b-4304-b7ca-74d6e5be21d5 None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.143527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e140e-893b-4304-b7ca-74d6e5be21d5 None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.147116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e140e-893b-4304-b7ca-74d6e5be21d5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.156974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 188/375] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.158336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc058e-e87d-4b84-b8bb-fd77b8c7841b None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.158617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc058e-e87d-4b84-b8bb-fd77b8c7841b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.158882 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc058e-e87d-4b84-b8bb-fd77b8c7841b None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.160455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 189/376] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:05.165517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060ab5-ffea-4bb6-974c-0c2b3c9e3b2e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.165798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060ab5-ffea-4bb6-974c-0c2b3c9e3b2e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.166072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060ab5-ffea-4bb6-974c-0c2b3c9e3b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.192480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6e060ab5-ffea-4bb6-974c-0c2b3c9e3b2e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:05.193726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6e060ab5-ffea-4bb6-974c-0c2b3c9e3b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:05.231625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.237243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837481c2-211f-4d60-8d0c-9b78f8c552c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.239217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837481c2-211f-4d60-8d0c-9b78f8c552c7 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.253392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.278221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 190/377] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:05.279518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e060ab5-ffea-4bb6-974c-0c2b3c9e3b2e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.353542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 188/378] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:05.354292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837481c2-211f-4d60-8d0c-9b78f8c552c7 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.395867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e060ab5-ffea-4bb6-974c-0c2b3c9e3b2e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.443692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94371cd-7654-4a2e-bec0-57028c37dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.444868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94371cd-7654-4a2e-bec0-57028c37dd13 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.445361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94371cd-7654-4a2e-bec0-57028c37dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.445818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94371cd-7654-4a2e-bec0-57028c37dd13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.446753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94371cd-7654-4a2e-bec0-57028c37dd13 None admin] RBAC: Adding query filter params (group.id=eae44bf46daa4b719d95ab55b7afcee0, role.id=c6822f728eca477f81827dcc4c547bd0, scope.project.id=fe25744415024ccba84b98723af57001) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:05.447257 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94371cd-7654-4a2e-bec0-57028c37dd13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.448978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94371cd-7654-4a2e-bec0-57028c37dd13 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.455993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 191/379] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/role_assignments?group.id=eae44bf46daa4b719d95ab55b7afcee0&scope.project.id=fe25744415024ccba84b98723af57001&role.id=c6822f728eca477f81827dcc4c547bd0 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.461258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94371cd-7654-4a2e-bec0-57028c37dd13 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.481724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.486471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837481c2-211f-4d60-8d0c-9b78f8c552c7 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.529659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ba77c-f296-436f-a15f-e3f8535ed65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.530919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba77c-f296-436f-a15f-e3f8535ed65f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.531354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba77c-f296-436f-a15f-e3f8535ed65f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.532218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ba77c-f296-436f-a15f-e3f8535ed65f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.545235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ba77c-f296-436f-a15f-e3f8535ed65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-6d3ba77c-f296-436f-a15f-e3f8535ed65f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:05.551732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:05.552946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:05.553808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:05.556994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 189/380] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:05.563814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ba77c-f296-436f-a15f-e3f8535ed65f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.566615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.692542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ba77c-f296-436f-a15f-e3f8535ed65f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.731459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b1f26-2f24-4712-aa95-010351a0e5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.732469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b1f26-2f24-4712-aa95-010351a0e5fc None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.733114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b1f26-2f24-4712-aa95-010351a0e5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.734159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b1f26-2f24-4712-aa95-010351a0e5fc None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.735039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b1f26-2f24-4712-aa95-010351a0e5fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:05.735550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b1f26-2f24-4712-aa95-010351a0e5fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.737226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b1f26-2f24-4712-aa95-010351a0e5fc None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.746783 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 190/381] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.755331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b1f26-2f24-4712-aa95-010351a0e5fc None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.756678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94371cd-7654-4a2e-bec0-57028c37dd13 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.808974 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.832374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db74280-df45-4a8b-971f-ca4007d51c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.833037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db74280-df45-4a8b-971f-ca4007d51c24 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.833316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db74280-df45-4a8b-971f-ca4007d51c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.833589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db74280-df45-4a8b-971f-ca4007d51c24 None admin] PATH_INFO: `/v3/projects/95743c69ba944a32817628bc182e9a85` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.836631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db74280-df45-4a8b-971f-ca4007d51c24 None admin] RBAC: Authorizing `identity:get_project(project_id=95743c69ba944a32817628bc182e9a85)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.838077 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db74280-df45-4a8b-971f-ca4007d51c24 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.839722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 192/382] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/projects/95743c69ba944a32817628bc182e9a85 => generated 344 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.845712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db74280-df45-4a8b-971f-ca4007d51c24 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.930386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b1f26-2f24-4712-aa95-010351a0e5fc None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.970933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5f363-986d-4c5b-9c1a-0b98044d5183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.972162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5f363-986d-4c5b-9c1a-0b98044d5183 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.972162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5f363-986d-4c5b-9c1a-0b98044d5183 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.972162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5f363-986d-4c5b-9c1a-0b98044d5183 None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.975758 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5f363-986d-4c5b-9c1a-0b98044d5183 None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.975758 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5f363-986d-4c5b-9c1a-0b98044d5183 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.976647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 191/383] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.981957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5f363-986d-4c5b-9c1a-0b98044d5183 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.010537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db74280-df45-4a8b-971f-ca4007d51c24 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.027433 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:06.052763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b2c45-e259-4a75-8947-81f2d970fa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.053776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b2c45-e259-4a75-8947-81f2d970fa42 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.054256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b2c45-e259-4a75-8947-81f2d970fa42 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.054774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b2c45-e259-4a75-8947-81f2d970fa42 None admin] PATH_INFO: `/v3/groups/1c768e9cea48414b80123b5fc0267f39` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.063157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b2c45-e259-4a75-8947-81f2d970fa42 None admin] RBAC: Authorizing `identity:get_group(group_id=1c768e9cea48414b80123b5fc0267f39)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.065039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b2c45-e259-4a75-8947-81f2d970fa42 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.067830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 193/384] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/groups/1c768e9cea48414b80123b5fc0267f39 => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:06.077887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b2c45-e259-4a75-8947-81f2d970fa42 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.164190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:06.176674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5f363-986d-4c5b-9c1a-0b98044d5183 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.215322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944780a-ceaa-4f7c-b557-ac829cc0aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.215963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944780a-ceaa-4f7c-b557-ac829cc0aea5 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.216235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944780a-ceaa-4f7c-b557-ac829cc0aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.216502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944780a-ceaa-4f7c-b557-ac829cc0aea5 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.220399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944780a-ceaa-4f7c-b557-ac829cc0aea5 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.222030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944780a-ceaa-4f7c-b557-ac829cc0aea5 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.223927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 192/385] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:06.229947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944780a-ceaa-4f7c-b557-ac829cc0aea5 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.243193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b2c45-e259-4a75-8947-81f2d970fa42 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.322878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199d2c8-0989-4b10-94c6-0c5f503f3cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.323607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199d2c8-0989-4b10-94c6-0c5f503f3cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.323884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199d2c8-0989-4b10-94c6-0c5f503f3cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.324272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199d2c8-0989-4b10-94c6-0c5f503f3cd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.325033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199d2c8-0989-4b10-94c6-0c5f503f3cd3 None admin] RBAC: Adding query filter params (group.id=1c768e9cea48414b80123b5fc0267f39, role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=95743c69ba944a32817628bc182e9a85) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:06.325349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199d2c8-0989-4b10-94c6-0c5f503f3cd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.333413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199d2c8-0989-4b10-94c6-0c5f503f3cd3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.339760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 194/386] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:06 2022] GET /identity/v3/role_assignments?group.id=1c768e9cea48414b80123b5fc0267f39&scope.project.id=95743c69ba944a32817628bc182e9a85&role.id=d6155b01aace49f887f29aa2861d31cf => generated 260 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:06.394191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944780a-ceaa-4f7c-b557-ac829cc0aea5 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.454710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab6f2f-ed0d-418f-80fd-9609037f1479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.455689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6f2f-ed0d-418f-80fd-9609037f1479 None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.456168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6f2f-ed0d-418f-80fd-9609037f1479 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.456651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6f2f-ed0d-418f-80fd-9609037f1479 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a/groups/eae44bf46daa4b719d95ab55b7afcee0/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.458927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab6f2f-ed0d-418f-80fd-9609037f1479 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd32494f9acf41b2af293e24ff51e99a, group_id=eae44bf46daa4b719d95ab55b7afcee0, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.460605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab6f2f-ed0d-418f-80fd-9609037f1479 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.485223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 193/387] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Aug 9 12:09:06 2022] PUT /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a/groups/eae44bf46daa4b719d95ab55b7afcee0/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:06.743126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c8c35-00b9-40ed-b71b-9fc888a13c24 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.743463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c8c35-00b9-40ed-b71b-9fc888a13c24 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.743575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c8c35-00b9-40ed-b71b-9fc888a13c24 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.745109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 195/388] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:06.751881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43390420-a211-4e64-a878-3e25af2b8168 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.752455 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43390420-a211-4e64-a878-3e25af2b8168 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.752967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43390420-a211-4e64-a878-3e25af2b8168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.773468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-43390420-a211-4e64-a878-3e25af2b8168 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:06.775027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-43390420-a211-4e64-a878-3e25af2b8168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:06.792379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:06.865811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 194/389] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:06.906358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c8c35-00b9-40ed-b71b-9fc888a13c24 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.965246 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:07.033820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c8c35-00b9-40ed-b71b-9fc888a13c24 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:07.082437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e184a-a2b8-4d2f-8ec1-1ff7f8ec647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:07.083075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e184a-a2b8-4d2f-8ec1-1ff7f8ec647f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:07.083342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e184a-a2b8-4d2f-8ec1-1ff7f8ec647f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:07.083614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e184a-a2b8-4d2f-8ec1-1ff7f8ec647f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:07.099805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e184a-a2b8-4d2f-8ec1-1ff7f8ec647f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-dc5e184a-a2b8-4d2f-8ec1-1ff7f8ec647f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:07.104534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:07.105439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:07.106314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:07.110623 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 196/390] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:07.116393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43390420-a211-4e64-a878-3e25af2b8168 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:07.316820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43390420-a211-4e64-a878-3e25af2b8168 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:07.362531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd29bf9-236a-4fa7-8dec-5d9401def490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:07.363143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd29bf9-236a-4fa7-8dec-5d9401def490 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:07.363420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd29bf9-236a-4fa7-8dec-5d9401def490 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:07.363689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd29bf9-236a-4fa7-8dec-5d9401def490 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:07.364349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd29bf9-236a-4fa7-8dec-5d9401def490 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:07.364669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd29bf9-236a-4fa7-8dec-5d9401def490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:07.366055 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd29bf9-236a-4fa7-8dec-5d9401def490 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:07.377030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 195/391] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:07.382181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e184a-a2b8-4d2f-8ec1-1ff7f8ec647f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:07.497957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ad9e3-caf1-411c-9008-5c828617dea4 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:07.498264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ad9e3-caf1-411c-9008-5c828617dea4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:07.498506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ad9e3-caf1-411c-9008-5c828617dea4 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:07.500777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 196/392] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:07.505651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31453c62-b0ac-4d39-bc6e-989d552fd7b3 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:07.505932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31453c62-b0ac-4d39-bc6e-989d552fd7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:07.506208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31453c62-b0ac-4d39-bc6e-989d552fd7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:07.506888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:07.510183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e184a-a2b8-4d2f-8ec1-1ff7f8ec647f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:07.541625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-31453c62-b0ac-4d39-bc6e-989d552fd7b3 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:07.542820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-31453c62-b0ac-4d39-bc6e-989d552fd7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:07.549406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:07.551072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbd39d-05a8-48c7-a15e-474807d098c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:07.551713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbd39d-05a8-48c7-a15e-474807d098c8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:07.551992 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbd39d-05a8-48c7-a15e-474807d098c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:07.552266 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbd39d-05a8-48c7-a15e-474807d098c8 None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:07.553423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbd39d-05a8-48c7-a15e-474807d098c8 None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:07.554877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbd39d-05a8-48c7-a15e-474807d098c8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:07.559169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 197/393] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:07 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:07.562944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbd39d-05a8-48c7-a15e-474807d098c8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:07.690741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 197/394] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:07.737114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbd39d-05a8-48c7-a15e-474807d098c8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:07.749685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31453c62-b0ac-4d39-bc6e-989d552fd7b3 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:07.803447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91038898-b87d-430f-99b3-7752f41c0401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:07.804602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91038898-b87d-430f-99b3-7752f41c0401 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:07.806136 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91038898-b87d-430f-99b3-7752f41c0401 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:07.807289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91038898-b87d-430f-99b3-7752f41c0401 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:07.809176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91038898-b87d-430f-99b3-7752f41c0401 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:07.810961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91038898-b87d-430f-99b3-7752f41c0401 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:07.816103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 198/395] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:07 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:07.822693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91038898-b87d-430f-99b3-7752f41c0401 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:07.867648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:07.946318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31453c62-b0ac-4d39-bc6e-989d552fd7b3 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:07.993541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91038898-b87d-430f-99b3-7752f41c0401 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.010796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecdb0e-3836-4755-a5e2-a7db406dd4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.011438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecdb0e-3836-4755-a5e2-a7db406dd4bb None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.011714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecdb0e-3836-4755-a5e2-a7db406dd4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.011990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecdb0e-3836-4755-a5e2-a7db406dd4bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.027305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:08.029246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecdb0e-3836-4755-a5e2-a7db406dd4bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-d7ecdb0e-3836-4755-a5e2-a7db406dd4bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:08.034169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:08.035053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:08.035864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 198/396] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:08.043657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecdb0e-3836-4755-a5e2-a7db406dd4bb None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.063635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132fc0f-affc-4dd0-9935-ac688f14e12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.064355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132fc0f-affc-4dd0-9935-ac688f14e12b None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.064668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132fc0f-affc-4dd0-9935-ac688f14e12b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.065389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132fc0f-affc-4dd0-9935-ac688f14e12b None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a/groups/eae44bf46daa4b719d95ab55b7afcee0/roles/c6822f728eca477f81827dcc4c547bd0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.068819 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132fc0f-affc-4dd0-9935-ac688f14e12b None admin] RBAC: Authorizing `identity:create_grant(project_id=bd32494f9acf41b2af293e24ff51e99a, group_id=eae44bf46daa4b719d95ab55b7afcee0, role_id=c6822f728eca477f81827dcc4c547bd0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.070303 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132fc0f-affc-4dd0-9935-ac688f14e12b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.089083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 199/397] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Aug 9 12:09:07 2022] PUT /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a/groups/eae44bf46daa4b719d95ab55b7afcee0/roles/c6822f728eca477f81827dcc4c547bd0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:08.090665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c96d5-3901-4ef4-85ba-f294d6200be9 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.090949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c96d5-3901-4ef4-85ba-f294d6200be9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.091219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c96d5-3901-4ef4-85ba-f294d6200be9 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.094845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 200/398] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:08.104802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f11f1-fce3-4b41-8883-b88cfa58ced3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.105101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f11f1-fce3-4b41-8883-b88cfa58ced3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.105349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f11f1-fce3-4b41-8883-b88cfa58ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.141882 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-aa5f11f1-fce3-4b41-8883-b88cfa58ced3 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:08.143098 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-aa5f11f1-fce3-4b41-8883-b88cfa58ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:08.251948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecdb0e-3836-4755-a5e2-a7db406dd4bb None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.299173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 201/399] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:08.304469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b390de-e8b7-4ef9-96e8-44efc5f5d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.305108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b390de-e8b7-4ef9-96e8-44efc5f5d74e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.305384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b390de-e8b7-4ef9-96e8-44efc5f5d74e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.305650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b390de-e8b7-4ef9-96e8-44efc5f5d74e None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.312815 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b390de-e8b7-4ef9-96e8-44efc5f5d74e None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:08.313604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b390de-e8b7-4ef9-96e8-44efc5f5d74e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.315067 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b390de-e8b7-4ef9-96e8-44efc5f5d74e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.323401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f11f1-fce3-4b41-8883-b88cfa58ced3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.324539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 199/400] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:08.330014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b390de-e8b7-4ef9-96e8-44efc5f5d74e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.358395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:08.428996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:08.507427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f11f1-fce3-4b41-8883-b88cfa58ced3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.511459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b390de-e8b7-4ef9-96e8-44efc5f5d74e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.573023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc9551-f978-47d9-b05e-e6ca9efdd654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.573821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc9551-f978-47d9-b05e-e6ca9efdd654 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.574128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc9551-f978-47d9-b05e-e6ca9efdd654 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.574490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc9551-f978-47d9-b05e-e6ca9efdd654 None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.575766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc9551-f978-47d9-b05e-e6ca9efdd654 None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.577405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc9551-f978-47d9-b05e-e6ca9efdd654 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.579771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 200/401] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:08.581249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c85e02-a3fb-4b28-a8aa-3d6e10978973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.582171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c85e02-a3fb-4b28-a8aa-3d6e10978973 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.582706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c85e02-a3fb-4b28-a8aa-3d6e10978973 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.583179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c85e02-a3fb-4b28-a8aa-3d6e10978973 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.587005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc9551-f978-47d9-b05e-e6ca9efdd654 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.610448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c85e02-a3fb-4b28-a8aa-3d6e10978973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-39c85e02-a3fb-4b28-a8aa-3d6e10978973 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:08.615226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:08.616091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:08.617288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 202/402] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:08.626080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c85e02-a3fb-4b28-a8aa-3d6e10978973 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.781829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:08.794910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc9551-f978-47d9-b05e-e6ca9efdd654 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.805668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c85e02-a3fb-4b28-a8aa-3d6e10978973 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.853003 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:08.860653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed382704-3395-4d8c-9f72-fcb3763e1d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.861396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382704-3395-4d8c-9f72-fcb3763e1d95 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.861722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382704-3395-4d8c-9f72-fcb3763e1d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.861996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382704-3395-4d8c-9f72-fcb3763e1d95 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.863104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed382704-3395-4d8c-9f72-fcb3763e1d95 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.864799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed382704-3395-4d8c-9f72-fcb3763e1d95 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.865372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ddc99-3622-4c47-bba4-920b379179b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.866167 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ddc99-3622-4c47-bba4-920b379179b6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.866618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ddc99-3622-4c47-bba4-920b379179b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.866720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 201/403] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:08.867143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ddc99-3622-4c47-bba4-920b379179b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.872418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464238f-d2bd-4e6a-b026-1785199a35b8 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.872418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464238f-d2bd-4e6a-b026-1785199a35b8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.872418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464238f-d2bd-4e6a-b026-1785199a35b8 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.872418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 202/404] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:08.873248 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ddc99-3622-4c47-bba4-920b379179b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:08.873521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464238f-d2bd-4e6a-b026-1785199a35b8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.873878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ddc99-3622-4c47-bba4-920b379179b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.875985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ddc99-3622-4c47-bba4-920b379179b6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.889008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 203/405] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:08.891128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9f328-4936-4886-b5fe-9ee6ebf8a9c7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.891601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9f328-4936-4886-b5fe-9ee6ebf8a9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.892044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9f328-4936-4886-b5fe-9ee6ebf8a9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.911827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fbe9f328-4936-4886-b5fe-9ee6ebf8a9c7 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:08.913128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fbe9f328-4936-4886-b5fe-9ee6ebf8a9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:08.982033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 204/406] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:08.982895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9f328-4936-4886-b5fe-9ee6ebf8a9c7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.985459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464238f-d2bd-4e6a-b026-1785199a35b8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.020881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b416467-703b-4da4-8c78-f2c7e4ad7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.021539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b416467-703b-4da4-8c78-f2c7e4ad7e9d None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.021815 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b416467-703b-4da4-8c78-f2c7e4ad7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.022084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b416467-703b-4da4-8c78-f2c7e4ad7e9d None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001/groups/eae44bf46daa4b719d95ab55b7afcee0/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.024080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b416467-703b-4da4-8c78-f2c7e4ad7e9d None admin] RBAC: Authorizing `identity:create_grant(project_id=fe25744415024ccba84b98723af57001, group_id=eae44bf46daa4b719d95ab55b7afcee0, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.025536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b416467-703b-4da4-8c78-f2c7e4ad7e9d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.041424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 203/407] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Aug 9 12:09:08 2022] PUT /identity/v3/projects/fe25744415024ccba84b98723af57001/groups/eae44bf46daa4b719d95ab55b7afcee0/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:09:09.042294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b416467-703b-4da4-8c78-f2c7e4ad7e9d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.074728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.107582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9f328-4936-4886-b5fe-9ee6ebf8a9c7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.121134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.157796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9280080-06c5-4faf-a9be-58e587f97356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.158457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9280080-06c5-4faf-a9be-58e587f97356 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.158732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9280080-06c5-4faf-a9be-58e587f97356 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.158996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9280080-06c5-4faf-a9be-58e587f97356 None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.160148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9280080-06c5-4faf-a9be-58e587f97356 None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.161757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9280080-06c5-4faf-a9be-58e587f97356 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.163941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 205/408] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:09.169013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba7300-fc8b-4e55-bf6b-ddf5aa117086 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.169013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba7300-fc8b-4e55-bf6b-ddf5aa117086 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.169013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba7300-fc8b-4e55-bf6b-ddf5aa117086 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.169013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 206/409] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:09.170517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba7300-fc8b-4e55-bf6b-ddf5aa117086 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.179268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b416467-703b-4da4-8c78-f2c7e4ad7e9d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.226803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e809cd-ceae-44ee-bd82-7161101edb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.227569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e809cd-ceae-44ee-bd82-7161101edb85 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.227903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e809cd-ceae-44ee-bd82-7161101edb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.228238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e809cd-ceae-44ee-bd82-7161101edb85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.243838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e809cd-ceae-44ee-bd82-7161101edb85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-f8e809cd-ceae-44ee-bd82-7161101edb85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:09.249177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:09.250075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:09.250881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 204/410] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:09.251571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417ae35-7f27-487c-a9d4-46fe57bf2d0d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.252117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417ae35-7f27-487c-a9d4-46fe57bf2d0d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.252117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417ae35-7f27-487c-a9d4-46fe57bf2d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.270199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4417ae35-7f27-487c-a9d4-46fe57bf2d0d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:09.271589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4417ae35-7f27-487c-a9d4-46fe57bf2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:09.316123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba7300-fc8b-4e55-bf6b-ddf5aa117086 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.341709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 205/411] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:09.342916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417ae35-7f27-487c-a9d4-46fe57bf2d0d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.355299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169965f-a991-49ba-af8b-bcb8c7131ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.355932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169965f-a991-49ba-af8b-bcb8c7131ebb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.356208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169965f-a991-49ba-af8b-bcb8c7131ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.356533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169965f-a991-49ba-af8b-bcb8c7131ebb None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.357849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169965f-a991-49ba-af8b-bcb8c7131ebb None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.359969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169965f-a991-49ba-af8b-bcb8c7131ebb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.362182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 207/412] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:09.373648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169965f-a991-49ba-af8b-bcb8c7131ebb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.393953 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.412774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.486107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417ae35-7f27-487c-a9d4-46fe57bf2d0d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.512326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169965f-a991-49ba-af8b-bcb8c7131ebb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.535199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f28c95-6979-433f-a6f8-7d81c28a52a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.536225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28c95-6979-433f-a6f8-7d81c28a52a5 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.537071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28c95-6979-433f-a6f8-7d81c28a52a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.537442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28c95-6979-433f-a6f8-7d81c28a52a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.538271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f28c95-6979-433f-a6f8-7d81c28a52a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:09.538672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f28c95-6979-433f-a6f8-7d81c28a52a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.540858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f28c95-6979-433f-a6f8-7d81c28a52a5 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.553456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 206/413] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:09.554296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f28c95-6979-433f-a6f8-7d81c28a52a5 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.564824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c458a-e0d9-44dd-9e49-7701c796d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.565560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c458a-e0d9-44dd-9e49-7701c796d00b None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.565898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c458a-e0d9-44dd-9e49-7701c796d00b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.566584 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c458a-e0d9-44dd-9e49-7701c796d00b None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001/groups/eae44bf46daa4b719d95ab55b7afcee0/roles/c6822f728eca477f81827dcc4c547bd0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.569535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c458a-e0d9-44dd-9e49-7701c796d00b None admin] RBAC: Authorizing `identity:create_grant(project_id=fe25744415024ccba84b98723af57001, group_id=eae44bf46daa4b719d95ab55b7afcee0, role_id=c6822f728eca477f81827dcc4c547bd0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.571524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c458a-e0d9-44dd-9e49-7701c796d00b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.588984 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 208/414] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Aug 9 12:09:09 2022] PUT /identity/v3/projects/fe25744415024ccba84b98723af57001/groups/eae44bf46daa4b719d95ab55b7afcee0/roles/c6822f728eca477f81827dcc4c547bd0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:09.590369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c458a-e0d9-44dd-9e49-7701c796d00b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.687137 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f28c95-6979-433f-a6f8-7d81c28a52a5 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.689217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.705833 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.734137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c458a-e0d9-44dd-9e49-7701c796d00b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.763801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c30c96-b5d4-4b5d-ab5f-fb70f36f6885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.764456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30c96-b5d4-4b5d-ab5f-fb70f36f6885 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.764819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30c96-b5d4-4b5d-ab5f-fb70f36f6885 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.765097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30c96-b5d4-4b5d-ab5f-fb70f36f6885 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.786301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c30c96-b5d4-4b5d-ab5f-fb70f36f6885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-28c30c96-b5d4-4b5d-ab5f-fb70f36f6885 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:09.792213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:09.793216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:09.794014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:09.800776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 207/415] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:09.805534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c30c96-b5d4-4b5d-ab5f-fb70f36f6885 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.814377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e9d97-7385-42de-b23c-067e3efb365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.815309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e9d97-7385-42de-b23c-067e3efb365d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.815807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e9d97-7385-42de-b23c-067e3efb365d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.816274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e9d97-7385-42de-b23c-067e3efb365d None admin] PATH_INFO: `/v3/groups/1c768e9cea48414b80123b5fc0267f39` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.818936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e9d97-7385-42de-b23c-067e3efb365d None admin] RBAC: Authorizing `identity:get_group(group_id=1c768e9cea48414b80123b5fc0267f39)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.821317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e9d97-7385-42de-b23c-067e3efb365d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.823599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 209/416] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/groups/1c768e9cea48414b80123b5fc0267f39 => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:09.829220 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e9d97-7385-42de-b23c-067e3efb365d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.970510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c30c96-b5d4-4b5d-ab5f-fb70f36f6885 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.998369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e9d97-7385-42de-b23c-067e3efb365d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:10.035440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6939cf7-1bed-4a5a-be09-74c3b49f65b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:10.036517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6939cf7-1bed-4a5a-be09-74c3b49f65b0 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.037044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6939cf7-1bed-4a5a-be09-74c3b49f65b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.037575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6939cf7-1bed-4a5a-be09-74c3b49f65b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.038438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6939cf7-1bed-4a5a-be09-74c3b49f65b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:10.038939 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6939cf7-1bed-4a5a-be09-74c3b49f65b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:10.040714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6939cf7-1bed-4a5a-be09-74c3b49f65b0 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:10.049882 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71603d9a-e464-440a-be17-85a5658368dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:10.050545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603d9a-e464-440a-be17-85a5658368dc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.050825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603d9a-e464-440a-be17-85a5658368dc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.051088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603d9a-e464-440a-be17-85a5658368dc None admin] PATH_INFO: `/v3/projects/95743c69ba944a32817628bc182e9a85` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.053152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71603d9a-e464-440a-be17-85a5658368dc None admin] RBAC: Authorizing `identity:get_project(project_id=95743c69ba944a32817628bc182e9a85)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:10.054586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71603d9a-e464-440a-be17-85a5658368dc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:10.056224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 210/417] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/projects/95743c69ba944a32817628bc182e9a85 => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:10.058546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 208/418] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:10.064734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71603d9a-e464-440a-be17-85a5658368dc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:10.065660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6939cf7-1bed-4a5a-be09-74c3b49f65b0 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:10.097088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:10.158071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:10.202176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71603d9a-e464-440a-be17-85a5658368dc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:10.243795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d7187-35c7-4f84-af52-8e40d3cba73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:10.244467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d7187-35c7-4f84-af52-8e40d3cba73e None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.244793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d7187-35c7-4f84-af52-8e40d3cba73e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.245071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d7187-35c7-4f84-af52-8e40d3cba73e None admin] PATH_INFO: `/v3/projects/95743c69ba944a32817628bc182e9a85/groups/1c768e9cea48414b80123b5fc0267f39/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.247109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d7187-35c7-4f84-af52-8e40d3cba73e None admin] RBAC: Authorizing `identity:create_grant(project_id=95743c69ba944a32817628bc182e9a85, group_id=1c768e9cea48414b80123b5fc0267f39, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:10.248858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d7187-35c7-4f84-af52-8e40d3cba73e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:10.291747 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 211/419] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Aug 9 12:09:10 2022] PUT /identity/v3/projects/95743c69ba944a32817628bc182e9a85/groups/1c768e9cea48414b80123b5fc0267f39/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:10.304981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6939cf7-1bed-4a5a-be09-74c3b49f65b0 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:10.346154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e4ed4-52a1-4d52-b7a0-9f1eac17fabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:10.346930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4ed4-52a1-4d52-b7a0-9f1eac17fabd None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.347148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4ed4-52a1-4d52-b7a0-9f1eac17fabd None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.347367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4ed4-52a1-4d52-b7a0-9f1eac17fabd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.425942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e4ed4-52a1-4d52-b7a0-9f1eac17fabd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:10.427416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e4ed4-52a1-4d52-b7a0-9f1eac17fabd None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:10.461376 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:10.536138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 209/420] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:10.541989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d7187-35c7-4f84-af52-8e40d3cba73e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:10.617562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:10.632091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d711e7-3200-4da7-87e3-81c5bbf8026c None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.632762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d711e7-3200-4da7-87e3-81c5bbf8026c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.633238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d711e7-3200-4da7-87e3-81c5bbf8026c None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.635984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 210/421] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:10.640815 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03881e77-6f1e-4eec-8191-5ea5e88c14c9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.641379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03881e77-6f1e-4eec-8191-5ea5e88c14c9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.641852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03881e77-6f1e-4eec-8191-5ea5e88c14c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.652585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d7187-35c7-4f84-af52-8e40d3cba73e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:10.663368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-03881e77-6f1e-4eec-8191-5ea5e88c14c9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:10.665073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-03881e77-6f1e-4eec-8191-5ea5e88c14c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:10.689332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cc789-67e2-43df-b641-1cdcbb14ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:10.689964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cc789-67e2-43df-b641-1cdcbb14ed8c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.690238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cc789-67e2-43df-b641-1cdcbb14ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.690505 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cc789-67e2-43df-b641-1cdcbb14ed8c None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.691742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cc789-67e2-43df-b641-1cdcbb14ed8c None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:10.693918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cc789-67e2-43df-b641-1cdcbb14ed8c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:10.695210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 212/422] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:10 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:10.701300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cc789-67e2-43df-b641-1cdcbb14ed8c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:10.760162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 211/423] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:10.781774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03881e77-6f1e-4eec-8191-5ea5e88c14c9 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:10.874900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cc789-67e2-43df-b641-1cdcbb14ed8c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:10.889520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:10.949324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cda00-8120-43dd-a435-fed1188e41df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:10.949964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cda00-8120-43dd-a435-fed1188e41df None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.950240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cda00-8120-43dd-a435-fed1188e41df None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.950511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cda00-8120-43dd-a435-fed1188e41df None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.952194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cda00-8120-43dd-a435-fed1188e41df None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:10.953786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cda00-8120-43dd-a435-fed1188e41df None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:10.955376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 213/424] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:10 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:10.960819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03881e77-6f1e-4eec-8191-5ea5e88c14c9 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:10.963127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cda00-8120-43dd-a435-fed1188e41df None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:10.979392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:11.029636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa808-8cc8-48e6-8313-891aa1f36816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.030309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa808-8cc8-48e6-8313-891aa1f36816 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.030769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa808-8cc8-48e6-8313-891aa1f36816 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.031042 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa808-8cc8-48e6-8313-891aa1f36816 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.052310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfa808-8cc8-48e6-8313-891aa1f36816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-20cfa808-8cc8-48e6-8313-891aa1f36816 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:11.057093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:11.057962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:11.058757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:11.059909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 212/425] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:11.069839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa808-8cc8-48e6-8313-891aa1f36816 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.137632 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cda00-8120-43dd-a435-fed1188e41df None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.175210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e3c98-f32d-4187-86c5-14c83c01f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.175817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e3c98-f32d-4187-86c5-14c83c01f3af None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.176093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e3c98-f32d-4187-86c5-14c83c01f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.176415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e3c98-f32d-4187-86c5-14c83c01f3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.177174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e3c98-f32d-4187-86c5-14c83c01f3af None admin] RBAC: Adding query filter params (group.id=eae44bf46daa4b719d95ab55b7afcee0, role.id=12dc9c7d75da4722bf4525a56eea0e47, scope.project.id=bd32494f9acf41b2af293e24ff51e99a) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:11.178024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e3c98-f32d-4187-86c5-14c83c01f3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:11.179488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e3c98-f32d-4187-86c5-14c83c01f3af None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:11.186102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 214/426] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:10 2022] GET /identity/v3/role_assignments?group.id=eae44bf46daa4b719d95ab55b7afcee0&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:11.255352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa808-8cc8-48e6-8313-891aa1f36816 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.281257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:11.299902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4690ce7-7987-46cc-a3da-c58db52e47ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.300528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690ce7-7987-46cc-a3da-c58db52e47ec None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.300830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690ce7-7987-46cc-a3da-c58db52e47ec None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.301100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690ce7-7987-46cc-a3da-c58db52e47ec None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.301814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4690ce7-7987-46cc-a3da-c58db52e47ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:11.302125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4690ce7-7987-46cc-a3da-c58db52e47ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:11.303518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4690ce7-7987-46cc-a3da-c58db52e47ec None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:11.313367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 213/427] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:11.319247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e3c98-f32d-4187-86c5-14c83c01f3af None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.385872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a6b58-65a8-4d98-b928-41a2d93ed00e None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.386386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a6b58-65a8-4d98-b928-41a2d93ed00e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.386459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a6b58-65a8-4d98-b928-41a2d93ed00e None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.388054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 214/428] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:11.397067 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3e27b-54e1-45e2-adf2-5b7b7f6691c5 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.397709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3e27b-54e1-45e2-adf2-5b7b7f6691c5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.398177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3e27b-54e1-45e2-adf2-5b7b7f6691c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.422155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-1df3e27b-54e1-45e2-adf2-5b7b7f6691c5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:11.424183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1df3e27b-54e1-45e2-adf2-5b7b7f6691c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:11.447299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:11.491678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e3c98-f32d-4187-86c5-14c83c01f3af None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.523067 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 215/429] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:11.529312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d6da-7467-4c67-89fb-646c4f4da174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.530027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d6da-7467-4c67-89fb-646c4f4da174 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.530471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d6da-7467-4c67-89fb-646c4f4da174 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.530865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d6da-7467-4c67-89fb-646c4f4da174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.550179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3e27b-54e1-45e2-adf2-5b7b7f6691c5 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.604742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9d6da-7467-4c67-89fb-646c4f4da174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:11.605600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9d6da-7467-4c67-89fb-646c4f4da174 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:11.682937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3e27b-54e1-45e2-adf2-5b7b7f6691c5 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.699162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:11.701386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:11.730592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b060f-b544-4ee8-b6a6-df2e42ecf2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.731730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b060f-b544-4ee8-b6a6-df2e42ecf2fc None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.732201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b060f-b544-4ee8-b6a6-df2e42ecf2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.732755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b060f-b544-4ee8-b6a6-df2e42ecf2fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.742702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 215/430] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:11.753733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b060f-b544-4ee8-b6a6-df2e42ecf2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:11.753903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d6da-7467-4c67-89fb-646c4f4da174 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-f54b060f-b544-4ee8-b6a6-df2e42ecf2fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:11.758524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:11.759396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:11.760681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 216/431] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:11.766239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b060f-b544-4ee8-b6a6-df2e42ecf2fc None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.885095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d6da-7467-4c67-89fb-646c4f4da174 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.903906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b060f-b544-4ee8-b6a6-df2e42ecf2fc None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.933324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924c321-954b-4361-98a8-1e761b86e1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.934924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c321-954b-4361-98a8-1e761b86e1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.935459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c321-954b-4361-98a8-1e761b86e1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.935931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c321-954b-4361-98a8-1e761b86e1c1 None admin] PATH_INFO: `/v3/projects/bd32494f9acf41b2af293e24ff51e99a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.938410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924c321-954b-4361-98a8-1e761b86e1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=bd32494f9acf41b2af293e24ff51e99a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:11.940878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924c321-954b-4361-98a8-1e761b86e1c1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:11.942749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 216/432] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/projects/bd32494f9acf41b2af293e24ff51e99a => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:11.946313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f5dd-8259-47ab-b4d8-36aaa800918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.946313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f5dd-8259-47ab-b4d8-36aaa800918d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.946313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f5dd-8259-47ab-b4d8-36aaa800918d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.946313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f5dd-8259-47ab-b4d8-36aaa800918d None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.946658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f5dd-8259-47ab-b4d8-36aaa800918d None admin] RBAC: Adding query filter params (name=member) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:11.946658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f5dd-8259-47ab-b4d8-36aaa800918d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:11.947520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f5dd-8259-47ab-b4d8-36aaa800918d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:11.949376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924c321-954b-4361-98a8-1e761b86e1c1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.960288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 217/433] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:11.965565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f5dd-8259-47ab-b4d8-36aaa800918d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.001563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.012966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.085986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924c321-954b-4361-98a8-1e761b86e1c1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.096888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f5dd-8259-47ab-b4d8-36aaa800918d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.134333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3664ee5-6fc0-4628-85f5-1e7297f3e42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.135077 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3664ee5-6fc0-4628-85f5-1e7297f3e42d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.135424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3664ee5-6fc0-4628-85f5-1e7297f3e42d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.135764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3664ee5-6fc0-4628-85f5-1e7297f3e42d None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.136981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3664ee5-6fc0-4628-85f5-1e7297f3e42d None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.137898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8061e5-9f8e-4410-a05e-efb8bb5438c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.138497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8061e5-9f8e-4410-a05e-efb8bb5438c9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.138588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3664ee5-6fc0-4628-85f5-1e7297f3e42d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.138772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8061e5-9f8e-4410-a05e-efb8bb5438c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.139036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8061e5-9f8e-4410-a05e-efb8bb5438c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.145317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 217/434] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:12.145317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532af53-05cb-454c-a429-1ae3bf292f21 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.145317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532af53-05cb-454c-a429-1ae3bf292f21 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.145317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532af53-05cb-454c-a429-1ae3bf292f21 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.145317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 218/435] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:12.149709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532af53-05cb-454c-a429-1ae3bf292f21 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.226029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8061e5-9f8e-4410-a05e-efb8bb5438c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.227611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8061e5-9f8e-4410-a05e-efb8bb5438c9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.264096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.279592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532af53-05cb-454c-a429-1ae3bf292f21 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.287868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.317700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595150-9839-4892-ae2e-d5ab0274e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.318297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595150-9839-4892-ae2e-d5ab0274e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.318568 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595150-9839-4892-ae2e-d5ab0274e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.318833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595150-9839-4892-ae2e-d5ab0274e2a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.319546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595150-9839-4892-ae2e-d5ab0274e2a1 None admin] RBAC: Adding query filter params (group.id=eae44bf46daa4b719d95ab55b7afcee0, role.id=c6822f728eca477f81827dcc4c547bd0, scope.project.id=bd32494f9acf41b2af293e24ff51e99a) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:12.320080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595150-9839-4892-ae2e-d5ab0274e2a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.321280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595150-9839-4892-ae2e-d5ab0274e2a1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.335492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 219/436] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/role_assignments?group.id=eae44bf46daa4b719d95ab55b7afcee0&scope.project.id=bd32494f9acf41b2af293e24ff51e99a&role.id=c6822f728eca477f81827dcc4c547bd0 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:12.335492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362b9ff-76e2-41b0-9032-da3cc4d24f48 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.335492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362b9ff-76e2-41b0-9032-da3cc4d24f48 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.335492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362b9ff-76e2-41b0-9032-da3cc4d24f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.344835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 218/437] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:12.350726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8061e5-9f8e-4410-a05e-efb8bb5438c9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.356743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f362b9ff-76e2-41b0-9032-da3cc4d24f48 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:12.358539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f362b9ff-76e2-41b0-9032-da3cc4d24f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:12.443407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 220/438] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:12.471866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362b9ff-76e2-41b0-9032-da3cc4d24f48 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.498062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8061e5-9f8e-4410-a05e-efb8bb5438c9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.541804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc310403-ccd7-45fd-bc5e-b84bfca03c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.542459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc310403-ccd7-45fd-bc5e-b84bfca03c1f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.542736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc310403-ccd7-45fd-bc5e-b84bfca03c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.543018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc310403-ccd7-45fd-bc5e-b84bfca03c1f None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.544327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc310403-ccd7-45fd-bc5e-b84bfca03c1f None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.545589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc310403-ccd7-45fd-bc5e-b84bfca03c1f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.547745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 219/439] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:12.553441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc310403-ccd7-45fd-bc5e-b84bfca03c1f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.558656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.594642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.598314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362b9ff-76e2-41b0-9032-da3cc4d24f48 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.640825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b84eb1-05ab-4826-a03c-aa17c318d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.641728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b84eb1-05ab-4826-a03c-aa17c318d92d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.642163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b84eb1-05ab-4826-a03c-aa17c318d92d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.642435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b84eb1-05ab-4826-a03c-aa17c318d92d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.658987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b84eb1-05ab-4826-a03c-aa17c318d92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c6b84eb1-05ab-4826-a03c-aa17c318d92d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:12.666359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:12.667927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:12.668923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 221/440] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:12.673420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b84eb1-05ab-4826-a03c-aa17c318d92d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.680613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc310403-ccd7-45fd-bc5e-b84bfca03c1f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.721218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3506c53-ebf3-4d9c-80a0-63bac3bb062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.721848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3506c53-ebf3-4d9c-80a0-63bac3bb062f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.722125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3506c53-ebf3-4d9c-80a0-63bac3bb062f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.722392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3506c53-ebf3-4d9c-80a0-63bac3bb062f None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.725237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3506c53-ebf3-4d9c-80a0-63bac3bb062f None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.726378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3506c53-ebf3-4d9c-80a0-63bac3bb062f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.728009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 220/441] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:12.734604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3506c53-ebf3-4d9c-80a0-63bac3bb062f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.812776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b84eb1-05ab-4826-a03c-aa17c318d92d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.829874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.851169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c0d70-39a6-42cd-9b86-838724b78c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.851778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0d70-39a6-42cd-9b86-838724b78c5e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.852054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0d70-39a6-42cd-9b86-838724b78c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.852321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0d70-39a6-42cd-9b86-838724b78c5e None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.853086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c0d70-39a6-42cd-9b86-838724b78c5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:12.853386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c0d70-39a6-42cd-9b86-838724b78c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.854781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c0d70-39a6-42cd-9b86-838724b78c5e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.860080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3506c53-ebf3-4d9c-80a0-63bac3bb062f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.862768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 222/442] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:12.864074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c08a-27f4-4a00-bb8f-8de917afd6f9 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.864361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c08a-27f4-4a00-bb8f-8de917afd6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.864644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c08a-27f4-4a00-bb8f-8de917afd6f9 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.865860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 223/443] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:12.868177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c08a-27f4-4a00-bb8f-8de917afd6f9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.894103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.899520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990bb36-022e-46be-a265-bed139c90260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.900112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990bb36-022e-46be-a265-bed139c90260 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.900387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990bb36-022e-46be-a265-bed139c90260 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.900684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990bb36-022e-46be-a265-bed139c90260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.901406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990bb36-022e-46be-a265-bed139c90260 None admin] RBAC: Adding query filter params (group.id=eae44bf46daa4b719d95ab55b7afcee0, role.id=12dc9c7d75da4722bf4525a56eea0e47, scope.project.id=fe25744415024ccba84b98723af57001) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:12.901708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990bb36-022e-46be-a265-bed139c90260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.903138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990bb36-022e-46be-a265-bed139c90260 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.908860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 221/444] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/role_assignments?group.id=eae44bf46daa4b719d95ab55b7afcee0&scope.project.id=fe25744415024ccba84b98723af57001&role.id=12dc9c7d75da4722bf4525a56eea0e47 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:12.909985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30d425-3a11-49a6-8231-cfd07f19f9d0 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.910274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30d425-3a11-49a6-8231-cfd07f19f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.910525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30d425-3a11-49a6-8231-cfd07f19f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.930277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-3e30d425-3a11-49a6-8231-cfd07f19f9d0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:12.931515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3e30d425-3a11-49a6-8231-cfd07f19f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:12.982802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c08a-27f4-4a00-bb8f-8de917afd6f9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.014859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 222/445] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:13.023159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a3a23-f49f-44f5-bd49-7b515c158c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.023784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a3a23-f49f-44f5-bd49-7b515c158c99 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.024062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a3a23-f49f-44f5-bd49-7b515c158c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.024329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a3a23-f49f-44f5-bd49-7b515c158c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.038145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30d425-3a11-49a6-8231-cfd07f19f9d0 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.106269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a3a23-f49f-44f5-bd49-7b515c158c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.107825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a3a23-f49f-44f5-bd49-7b515c158c99 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.118781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.134405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.166449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30d425-3a11-49a6-8231-cfd07f19f9d0 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.208101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4117f9e-7200-461f-89e7-3d0626fbfdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.208759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4117f9e-7200-461f-89e7-3d0626fbfdba None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.209034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4117f9e-7200-461f-89e7-3d0626fbfdba None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.209301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4117f9e-7200-461f-89e7-3d0626fbfdba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.221787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4117f9e-7200-461f-89e7-3d0626fbfdba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-e4117f9e-7200-461f-89e7-3d0626fbfdba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:13.226726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:13.227630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:13.228417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:13.229596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 224/447] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:13.232738 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 223/447] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:13.235231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a3a23-f49f-44f5-bd49-7b515c158c99 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.235926 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4117f9e-7200-461f-89e7-3d0626fbfdba None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.337508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a3a23-f49f-44f5-bd49-7b515c158c99 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.342815 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4117f9e-7200-461f-89e7-3d0626fbfdba None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.360111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.368454 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.372499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1882b-2887-44bc-a183-be85c1fe04e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.373114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1882b-2887-44bc-a183-be85c1fe04e1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.373387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1882b-2887-44bc-a183-be85c1fe04e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.373655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1882b-2887-44bc-a183-be85c1fe04e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.374859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1882b-2887-44bc-a183-be85c1fe04e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:13.375224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1882b-2887-44bc-a183-be85c1fe04e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.376491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1882b-2887-44bc-a183-be85c1fe04e1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.377813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b591e-86aa-4d9d-a451-f4528638b074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.378416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b591e-86aa-4d9d-a451-f4528638b074 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.378705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b591e-86aa-4d9d-a451-f4528638b074 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.378974 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b591e-86aa-4d9d-a451-f4528638b074 None admin] PATH_INFO: `/v3/projects/fe25744415024ccba84b98723af57001` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.380082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b591e-86aa-4d9d-a451-f4528638b074 None admin] RBAC: Authorizing `identity:get_project(project_id=fe25744415024ccba84b98723af57001)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.381533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b591e-86aa-4d9d-a451-f4528638b074 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.383145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 224/448] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/projects/fe25744415024ccba84b98723af57001 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:13.384484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 225/449] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:13.388785 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b591e-86aa-4d9d-a451-f4528638b074 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.390443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1882b-2887-44bc-a183-be85c1fe04e1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.487673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1882b-2887-44bc-a183-be85c1fe04e1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.492653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b591e-86aa-4d9d-a451-f4528638b074 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.521420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169932a2-4137-4dc3-9794-cf09572b0ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.522134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169932a2-4137-4dc3-9794-cf09572b0ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.522414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169932a2-4137-4dc3-9794-cf09572b0ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.522678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169932a2-4137-4dc3-9794-cf09572b0ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.525965 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf0fba-c402-4465-97d2-4d1f79ae7a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.526576 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0fba-c402-4465-97d2-4d1f79ae7a71 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.526849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0fba-c402-4465-97d2-4d1f79ae7a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.527115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0fba-c402-4465-97d2-4d1f79ae7a71 None admin] PATH_INFO: `/v3/groups/eae44bf46daa4b719d95ab55b7afcee0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.528212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf0fba-c402-4465-97d2-4d1f79ae7a71 None admin] RBAC: Authorizing `identity:get_group(group_id=eae44bf46daa4b719d95ab55b7afcee0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.529685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf0fba-c402-4465-97d2-4d1f79ae7a71 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.531479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 225/450] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/groups/eae44bf46daa4b719d95ab55b7afcee0 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:13.537121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf0fba-c402-4465-97d2-4d1f79ae7a71 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.573210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.589912 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169932a2-4137-4dc3-9794-cf09572b0ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.591354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169932a2-4137-4dc3-9794-cf09572b0ce7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.597721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.636107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf0fba-c402-4465-97d2-4d1f79ae7a71 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.671739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab77c64-b7dc-4da4-a1aa-14bf5da49011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.672325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab77c64-b7dc-4da4-a1aa-14bf5da49011 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.672599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab77c64-b7dc-4da4-a1aa-14bf5da49011 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.672895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab77c64-b7dc-4da4-a1aa-14bf5da49011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.673874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab77c64-b7dc-4da4-a1aa-14bf5da49011 None admin] RBAC: Adding query filter params (group.id=eae44bf46daa4b719d95ab55b7afcee0, role.id=c6822f728eca477f81827dcc4c547bd0, scope.project.id=fe25744415024ccba84b98723af57001) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:13.674180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab77c64-b7dc-4da4-a1aa-14bf5da49011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.675593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab77c64-b7dc-4da4-a1aa-14bf5da49011 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.681203 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 226/451] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/role_assignments?group.id=eae44bf46daa4b719d95ab55b7afcee0&scope.project.id=fe25744415024ccba84b98723af57001&role.id=c6822f728eca477f81827dcc4c547bd0 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:13.692145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 226/452] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:13.698309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab77c64-b7dc-4da4-a1aa-14bf5da49011 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.803907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab77c64-b7dc-4da4-a1aa-14bf5da49011 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.831019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.840041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ff3b-d02c-42e1-a464-10f334fd552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.840700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ff3b-d02c-42e1-a464-10f334fd552f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.840982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ff3b-d02c-42e1-a464-10f334fd552f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.841251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ff3b-d02c-42e1-a464-10f334fd552f None admin] PATH_INFO: `/v3/projects/95743c69ba944a32817628bc182e9a85` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.842366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359ff3b-d02c-42e1-a464-10f334fd552f None admin] RBAC: Authorizing `identity:get_project(project_id=95743c69ba944a32817628bc182e9a85)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.844398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359ff3b-d02c-42e1-a464-10f334fd552f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.846129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 227/453] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/projects/95743c69ba944a32817628bc182e9a85 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:13.851596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169932a2-4137-4dc3-9794-cf09572b0ce7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.942594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.959119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169932a2-4137-4dc3-9794-cf09572b0ce7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.993488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a62de-5fdd-4b49-a88e-7e2b4d45fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.994117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a62de-5fdd-4b49-a88e-7e2b4d45fe92 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.994437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a62de-5fdd-4b49-a88e-7e2b4d45fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.994709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a62de-5fdd-4b49-a88e-7e2b4d45fe92 None admin] PATH_INFO: `/v3/groups/1c768e9cea48414b80123b5fc0267f39` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.995820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a62de-5fdd-4b49-a88e-7e2b4d45fe92 None admin] RBAC: Authorizing `identity:get_group(group_id=1c768e9cea48414b80123b5fc0267f39)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.997301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a62de-5fdd-4b49-a88e-7e2b4d45fe92 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.998877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 227/454] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/groups/1c768e9cea48414b80123b5fc0267f39 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:14.004868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ff3b-d02c-42e1-a464-10f334fd552f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:14.103243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ff3b-d02c-42e1-a464-10f334fd552f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:14.135082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845739d-52cf-4559-98dd-68fd688c566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:14.135669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845739d-52cf-4559-98dd-68fd688c566a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:14.135943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845739d-52cf-4559-98dd-68fd688c566a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:14.136211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845739d-52cf-4559-98dd-68fd688c566a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:14.136949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845739d-52cf-4559-98dd-68fd688c566a None admin] RBAC: Adding query filter params (group.id=1c768e9cea48414b80123b5fc0267f39, role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=95743c69ba944a32817628bc182e9a85) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:14.137254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845739d-52cf-4559-98dd-68fd688c566a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:14.138671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845739d-52cf-4559-98dd-68fd688c566a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:14.144907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 228/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:14 2022] GET /identity/v3/role_assignments?group.id=1c768e9cea48414b80123b5fc0267f39&scope.project.id=95743c69ba944a32817628bc182e9a85&role.id=d6155b01aace49f887f29aa2861d31cf => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:16.678664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29408bed-1362-4152-bbdd-101a86659fed None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.679170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29408bed-1362-4152-bbdd-101a86659fed None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.679170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29408bed-1362-4152-bbdd-101a86659fed None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.680705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 228/456] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:16.686045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b13a3-9560-454b-b4ee-0f9b7105e19e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.686482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b13a3-9560-454b-b4ee-0f9b7105e19e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.686690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b13a3-9560-454b-b4ee-0f9b7105e19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.713557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a13b13a3-9560-454b-b4ee-0f9b7105e19e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:16.714740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a13b13a3-9560-454b-b4ee-0f9b7105e19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:16.753595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e5863-bcd1-4096-bb76-ad6e784c397c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.753595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e5863-bcd1-4096-bb76-ad6e784c397c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.753595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e5863-bcd1-4096-bb76-ad6e784c397c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.754357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 229/457] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:16.758306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855156c3-2d8c-45fc-9a15-b482dd97124a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.758812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855156c3-2d8c-45fc-9a15-b482dd97124a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.759279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855156c3-2d8c-45fc-9a15-b482dd97124a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.778036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-855156c3-2d8c-45fc-9a15-b482dd97124a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:16.779539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-855156c3-2d8c-45fc-9a15-b482dd97124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:16.794184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:16.822425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 229/458] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:16.858762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b13a3-9560-454b-b4ee-0f9b7105e19e None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:16.879520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 230/459] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:16.926241 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855156c3-2d8c-45fc-9a15-b482dd97124a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.026148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b13a3-9560-454b-b4ee-0f9b7105e19e None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.057834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:17.070651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9222f-4654-4c4d-9645-0f76bcb1e3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.071752 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9222f-4654-4c4d-9645-0f76bcb1e3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.072229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9222f-4654-4c4d-9645-0f76bcb1e3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.073012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9222f-4654-4c4d-9645-0f76bcb1e3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.082741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855156c3-2d8c-45fc-9a15-b482dd97124a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.087452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9222f-4654-4c4d-9645-0f76bcb1e3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.089186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9222f-4654-4c4d-9645-0f76bcb1e3e7 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-61a9222f-4654-4c4d-9645-0f76bcb1e3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:17.110184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:17.111207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:17.112023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:17.112023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:17.112023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:17.114468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 230/460] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:17.116191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388078a-3365-481e-953f-1d83ff4cd861 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.116616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388078a-3365-481e-953f-1d83ff4cd861 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.117323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388078a-3365-481e-953f-1d83ff4cd861 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.119428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 231/461] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:17.120279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388078a-3365-481e-953f-1d83ff4cd861 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.127938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1f253-b24c-4c44-9706-2f5c108853dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.128200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1f253-b24c-4c44-9706-2f5c108853dd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.128572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1f253-b24c-4c44-9706-2f5c108853dd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.129113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1f253-b24c-4c44-9706-2f5c108853dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.141431 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1f253-b24c-4c44-9706-2f5c108853dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.143220 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1f253-b24c-4c44-9706-2f5c108853dd None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-32d1f253-b24c-4c44-9706-2f5c108853dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:17.159712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:17.160863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:17.161880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:17.161880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:17.161880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:17.163441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 231/462] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:17.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecacff-9543-4b10-a9ed-be6f6e3a0e3a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.165581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecacff-9543-4b10-a9ed-be6f6e3a0e3a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.165944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecacff-9543-4b10-a9ed-be6f6e3a0e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.177184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:17.189709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e3ecacff-9543-4b10-a9ed-be6f6e3a0e3a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:17.191308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e3ecacff-9543-4b10-a9ed-be6f6e3a0e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:17.251426 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388078a-3365-481e-953f-1d83ff4cd861 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.269434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 232/463] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:17.270782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecacff-9543-4b10-a9ed-be6f6e3a0e3a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.307191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094ff4-2a36-47df-a72b-e7e3f2f46a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.307717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094ff4-2a36-47df-a72b-e7e3f2f46a50 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.307992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094ff4-2a36-47df-a72b-e7e3f2f46a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.308258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094ff4-2a36-47df-a72b-e7e3f2f46a50 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.308943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c094ff4-2a36-47df-a72b-e7e3f2f46a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:17.309298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c094ff4-2a36-47df-a72b-e7e3f2f46a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.310790 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c094ff4-2a36-47df-a72b-e7e3f2f46a50 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.337570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 232/464] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:17.338445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094ff4-2a36-47df-a72b-e7e3f2f46a50 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.345756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:17.393215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecacff-9543-4b10-a9ed-be6f6e3a0e3a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.435012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8b2cd-1880-4d6f-aa17-6c7b3f8eb604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.435748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b2cd-1880-4d6f-aa17-6c7b3f8eb604 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.436118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b2cd-1880-4d6f-aa17-6c7b3f8eb604 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.436788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b2cd-1880-4d6f-aa17-6c7b3f8eb604 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.437999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8b2cd-1880-4d6f-aa17-6c7b3f8eb604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:17.438499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8b2cd-1880-4d6f-aa17-6c7b3f8eb604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.440017 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8b2cd-1880-4d6f-aa17-6c7b3f8eb604 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.453938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 233/465] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:17.455003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8b2cd-1880-4d6f-aa17-6c7b3f8eb604 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.461979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:17.465129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094ff4-2a36-47df-a72b-e7e3f2f46a50 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.514361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed202bd8-db31-4c44-8106-a8d231dea45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.515874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed202bd8-db31-4c44-8106-a8d231dea45d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.516247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed202bd8-db31-4c44-8106-a8d231dea45d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.516693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed202bd8-db31-4c44-8106-a8d231dea45d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.527877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed202bd8-db31-4c44-8106-a8d231dea45d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.529468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed202bd8-db31-4c44-8106-a8d231dea45d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-ed202bd8-db31-4c44-8106-a8d231dea45d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:17.547252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:17.548456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:17.549399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:17.549399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:17.549399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:17.549399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 233/466] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:17.554810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed202bd8-db31-4c44-8106-a8d231dea45d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.570130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8b2cd-1880-4d6f-aa17-6c7b3f8eb604 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.596508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:17.611524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e78b4-dca8-4a09-b944-70bfd5f156f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.612134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e78b4-dca8-4a09-b944-70bfd5f156f6 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.612408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e78b4-dca8-4a09-b944-70bfd5f156f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.612694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e78b4-dca8-4a09-b944-70bfd5f156f6 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.613332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e78b4-dca8-4a09-b944-70bfd5f156f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.614764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e78b4-dca8-4a09-b944-70bfd5f156f6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.640988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 234/467] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:17 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:17.640988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d85d01-b18a-4348-a58c-c3e9cd8ee0ae None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.640988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d85d01-b18a-4348-a58c-c3e9cd8ee0ae None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.640988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d85d01-b18a-4348-a58c-c3e9cd8ee0ae None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.640988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 235/468] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:17.644464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d85d01-b18a-4348-a58c-c3e9cd8ee0ae None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.673120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed202bd8-db31-4c44-8106-a8d231dea45d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.714685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec58b-116a-4c6b-8bbd-1d8a814a5597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.715350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec58b-116a-4c6b-8bbd-1d8a814a5597 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.715631 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec58b-116a-4c6b-8bbd-1d8a814a5597 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.715906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec58b-116a-4c6b-8bbd-1d8a814a5597 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.716560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ec58b-116a-4c6b-8bbd-1d8a814a5597 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.718193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ec58b-116a-4c6b-8bbd-1d8a814a5597 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.748842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 234/469] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:17 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:17.752568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df7b95-5ca4-4e90-885c-7ab31ababa0e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.752980 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df7b95-5ca4-4e90-885c-7ab31ababa0e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.753146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df7b95-5ca4-4e90-885c-7ab31ababa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.784920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-69df7b95-5ca4-4e90-885c-7ab31ababa0e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:17.786758 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-69df7b95-5ca4-4e90-885c-7ab31ababa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:17.789956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:17.832581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d85d01-b18a-4348-a58c-c3e9cd8ee0ae None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.881916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd417-7ed5-43a5-b2c2-39ac67e8eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.882260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd417-7ed5-43a5-b2c2-39ac67e8eb68 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.882540 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd417-7ed5-43a5-b2c2-39ac67e8eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.882814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd417-7ed5-43a5-b2c2-39ac67e8eb68 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.883465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bd417-7ed5-43a5-b2c2-39ac67e8eb68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:17.883765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bd417-7ed5-43a5-b2c2-39ac67e8eb68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.885227 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bd417-7ed5-43a5-b2c2-39ac67e8eb68 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.892390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 235/470] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:17.894447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79769a-6a25-420e-9fd4-bab36c1761c4 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.894736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79769a-6a25-420e-9fd4-bab36c1761c4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.895007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79769a-6a25-420e-9fd4-bab36c1761c4 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.896580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 236/471] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:17.902580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d22a19-6c99-4ed5-8b02-57d505fe029e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.902858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d22a19-6c99-4ed5-8b02-57d505fe029e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.903126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d22a19-6c99-4ed5-8b02-57d505fe029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.904988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 236/472] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:17.910831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd417-7ed5-43a5-b2c2-39ac67e8eb68 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.933536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-26d22a19-6c99-4ed5-8b02-57d505fe029e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:17.934724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-26d22a19-6c99-4ed5-8b02-57d505fe029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:17.962275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:18.030375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd417-7ed5-43a5-b2c2-39ac67e8eb68 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.036744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 237/473] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:18.038413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d22a19-6c99-4ed5-8b02-57d505fe029e None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.067152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5525-5a90-45db-8206-fd67e45395ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.067771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5525-5a90-45db-8206-fd67e45395ac None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.068051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5525-5a90-45db-8206-fd67e45395ac None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.068322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5525-5a90-45db-8206-fd67e45395ac None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.068996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c5525-5a90-45db-8206-fd67e45395ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.070448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c5525-5a90-45db-8206-fd67e45395ac None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.100742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 237/474] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:17 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:09:18.100742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5525-5a90-45db-8206-fd67e45395ac None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.174584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:18.220120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:18.229471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5525-5a90-45db-8206-fd67e45395ac None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.270381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d62636-b7c9-4cd7-97ce-f2ec42e62128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.270943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d62636-b7c9-4cd7-97ce-f2ec42e62128 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.271252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d62636-b7c9-4cd7-97ce-f2ec42e62128 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.271495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d62636-b7c9-4cd7-97ce-f2ec42e62128 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.272165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d62636-b7c9-4cd7-97ce-f2ec42e62128 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.273802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d62636-b7c9-4cd7-97ce-f2ec42e62128 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.279923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d22a19-6c99-4ed5-8b02-57d505fe029e None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.282781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.sql.core [None req-f1d62636-b7c9-4cd7-97ce-f2ec42e62128 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 12:09:18.282781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 12:09:18.282781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [parameters: {'id': 'a640abf773c741cb86c26a16664ff4f0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 12:09:18.282781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f1d62636-b7c9-4cd7-97ce-f2ec42e62128 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application result.read() Aug 09 12:09:18.302363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return ref.to_dict() Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:09:18.303317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application yield resource Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise self.value Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application session.commit() Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 12:09:18.304277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.session.flush() Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application compat.raise_( Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 12:09:18.305159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:09:18.306040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application result.read() Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:09:18.308878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [parameters: {'id': 'a640abf773c741cb86c26a16664ff4f0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:18.310976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 12:09:18.313215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:18.317194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 238/475] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Aug 9 12:09:18 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:18.322962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d62636-b7c9-4cd7-97ce-f2ec42e62128 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.349339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f163f38-fa56-48f0-be09-2868deac6c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.349989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f163f38-fa56-48f0-be09-2868deac6c65 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.350265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f163f38-fa56-48f0-be09-2868deac6c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.350567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f163f38-fa56-48f0-be09-2868deac6c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.368249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f163f38-fa56-48f0-be09-2868deac6c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.371018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f163f38-fa56-48f0-be09-2868deac6c65 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-2f163f38-fa56-48f0-be09-2868deac6c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:18.392796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:18.394112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:18.394951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:18.394951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:18.394951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:18.399996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 238/476] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:18.401434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f163f38-fa56-48f0-be09-2868deac6c65 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.499899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d62636-b7c9-4cd7-97ce-f2ec42e62128 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.531505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f163f38-fa56-48f0-be09-2868deac6c65 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.554068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:18.570474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71e31-f09e-4b8f-a866-29b3762ceb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.571078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71e31-f09e-4b8f-a866-29b3762ceb5e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.571351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71e31-f09e-4b8f-a866-29b3762ceb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.571617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71e31-f09e-4b8f-a866-29b3762ceb5e None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.572319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71e31-f09e-4b8f-a866-29b3762ceb5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:18.572618 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71e31-f09e-4b8f-a866-29b3762ceb5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.574066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71e31-f09e-4b8f-a866-29b3762ceb5e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.574653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9f23a-e347-44a8-8015-d9fe9c88fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.575390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9f23a-e347-44a8-8015-d9fe9c88fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.575673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9f23a-e347-44a8-8015-d9fe9c88fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.575940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9f23a-e347-44a8-8015-d9fe9c88fbc2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.587918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 239/477] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:18.594404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71e31-f09e-4b8f-a866-29b3762ceb5e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.600519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9f23a-e347-44a8-8015-d9fe9c88fbc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ebe9f23a-e347-44a8-8015-d9fe9c88fbc2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:18.605760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:18.606615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:18.607402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 239/478] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:18.616065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9f23a-e347-44a8-8015-d9fe9c88fbc2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.660744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:18.788463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71e31-f09e-4b8f-a866-29b3762ceb5e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.821510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9f23a-e347-44a8-8015-d9fe9c88fbc2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.847057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a55e81-51c9-48a7-9614-90136045c9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.847661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55e81-51c9-48a7-9614-90136045c9b8 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.847938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55e81-51c9-48a7-9614-90136045c9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.848204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55e81-51c9-48a7-9614-90136045c9b8 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.848883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55e81-51c9-48a7-9614-90136045c9b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.850370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55e81-51c9-48a7-9614-90136045c9b8 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.875671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e2b60-8b98-48ab-a05c-cfbb36ce978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.876379 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e2b60-8b98-48ab-a05c-cfbb36ce978b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.876647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e2b60-8b98-48ab-a05c-cfbb36ce978b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.876927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e2b60-8b98-48ab-a05c-cfbb36ce978b None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.877803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e2b60-8b98-48ab-a05c-cfbb36ce978b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:18.881124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e2b60-8b98-48ab-a05c-cfbb36ce978b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.888770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 240/479] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:18 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:09:18.890522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e2b60-8b98-48ab-a05c-cfbb36ce978b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.904215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 240/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:20.108013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468423da-51b6-41ca-b2da-4c690cad50dd None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.109254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468423da-51b6-41ca-b2da-4c690cad50dd None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.109254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468423da-51b6-41ca-b2da-4c690cad50dd None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.110821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 241/481] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:20.115899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b98c0-c0b8-4ac9-895d-230b2b1bdebe None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.116293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b98c0-c0b8-4ac9-895d-230b2b1bdebe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.116454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b98c0-c0b8-4ac9-895d-230b2b1bdebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.141590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6a4b98c0-c0b8-4ac9-895d-230b2b1bdebe None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:20.142789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6a4b98c0-c0b8-4ac9-895d-230b2b1bdebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:20.235132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 241/482] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:20.236172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3001808-fdb0-4440-a608-e33d3604eed5 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.236450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3001808-fdb0-4440-a608-e33d3604eed5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.236754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3001808-fdb0-4440-a608-e33d3604eed5 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.238315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 242/483] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:20.243397 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3d243-8464-4c3b-8ca2-1b54d3e9912e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.243685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3d243-8464-4c3b-8ca2-1b54d3e9912e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.243960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3d243-8464-4c3b-8ca2-1b54d3e9912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.261233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3001808-fdb0-4440-a608-e33d3604eed5 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:20.262549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e2b3d243-8464-4c3b-8ca2-1b54d3e9912e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:20.263728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e2b3d243-8464-4c3b-8ca2-1b54d3e9912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:20.297017 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:20.339985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:20.348612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 242/484] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:20.382070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3d243-8464-4c3b-8ca2-1b54d3e9912e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:20.495591 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3001808-fdb0-4440-a608-e33d3604eed5 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:20.538955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3d243-8464-4c3b-8ca2-1b54d3e9912e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:20.562767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feea49a-5dab-420e-adf5-114154638eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:20.563394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feea49a-5dab-420e-adf5-114154638eba None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.563667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feea49a-5dab-420e-adf5-114154638eba None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.563934 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feea49a-5dab-420e-adf5-114154638eba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.584542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feea49a-5dab-420e-adf5-114154638eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-5feea49a-5dab-420e-adf5-114154638eba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:20.590279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:20.591134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:20.591940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 243/485] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:20.599502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feea49a-5dab-420e-adf5-114154638eba None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:20.617575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f49039-68fc-4db8-88d6-7127e9aec29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:20.618663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f49039-68fc-4db8-88d6-7127e9aec29d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.619106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f49039-68fc-4db8-88d6-7127e9aec29d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.619887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f49039-68fc-4db8-88d6-7127e9aec29d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.638701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f49039-68fc-4db8-88d6-7127e9aec29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-03f49039-68fc-4db8-88d6-7127e9aec29d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:20.645115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:20.645991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:20.646788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 243/486] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:20.649921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135fc16-adc0-4e18-a92f-9dfc3cf6c254 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.649921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135fc16-adc0-4e18-a92f-9dfc3cf6c254 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.651336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135fc16-adc0-4e18-a92f-9dfc3cf6c254 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.652704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 244/487] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:20.657613 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135fc16-adc0-4e18-a92f-9dfc3cf6c254 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:20.660374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:20.713093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:20.719976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feea49a-5dab-420e-adf5-114154638eba None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:20.762256 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30dcf3-208e-4499-ab4c-3cb7c48f816c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:20.763151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30dcf3-208e-4499-ab4c-3cb7c48f816c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.763625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30dcf3-208e-4499-ab4c-3cb7c48f816c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.764076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30dcf3-208e-4499-ab4c-3cb7c48f816c None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.765107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30dcf3-208e-4499-ab4c-3cb7c48f816c None admin] RBAC: Adding query filter params (name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:20.765644 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30dcf3-208e-4499-ab4c-3cb7c48f816c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:20.767244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30dcf3-208e-4499-ab4c-3cb7c48f816c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:20.780851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 244/488] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:20.782251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22798-c0ce-45cd-85eb-a2f1617797d0 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.782651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22798-c0ce-45cd-85eb-a2f1617797d0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.783020 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22798-c0ce-45cd-85eb-a2f1617797d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.790470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135fc16-adc0-4e18-a92f-9dfc3cf6c254 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:20.802832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-0ec22798-c0ce-45cd-85eb-a2f1617797d0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:20.804013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0ec22798-c0ce-45cd-85eb-a2f1617797d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:20.831603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7822d-2a11-4402-bf5c-f53626e56101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:20.832865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7822d-2a11-4402-bf5c-f53626e56101 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.833620 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7822d-2a11-4402-bf5c-f53626e56101 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.834574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7822d-2a11-4402-bf5c-f53626e56101 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.835794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7822d-2a11-4402-bf5c-f53626e56101 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:20.836537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7822d-2a11-4402-bf5c-f53626e56101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:20.838938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7822d-2a11-4402-bf5c-f53626e56101 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:20.850629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 245/489] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:20.852405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7822d-2a11-4402-bf5c-f53626e56101 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:20.882987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 245/490] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:20.890409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec22798-c0ce-45cd-85eb-a2f1617797d0 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:20.933996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:20.986175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7822d-2a11-4402-bf5c-f53626e56101 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.003493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.017444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec22798-c0ce-45cd-85eb-a2f1617797d0 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.025359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282a799-4cb0-43fd-b5cb-4d9dbfff9b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.026327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282a799-4cb0-43fd-b5cb-4d9dbfff9b60 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.026790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282a799-4cb0-43fd-b5cb-4d9dbfff9b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.027237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282a799-4cb0-43fd-b5cb-4d9dbfff9b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.039252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282a799-4cb0-43fd-b5cb-4d9dbfff9b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.041006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282a799-4cb0-43fd-b5cb-4d9dbfff9b60 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.054295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ac96-7c38-4efb-b220-371fa5978548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.054916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ac96-7c38-4efb-b220-371fa5978548 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.055189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ac96-7c38-4efb-b220-371fa5978548 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.055460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ac96-7c38-4efb-b220-371fa5978548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3282a799-4cb0-43fd-b5cb-4d9dbfff9b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:21.057424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:21.058492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:21.059471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:21.059471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:21.059471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:21.060834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 246/491] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:21.062693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282a799-4cb0-43fd-b5cb-4d9dbfff9b60 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.071187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ac96-7c38-4efb-b220-371fa5978548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.073076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ac96-7c38-4efb-b220-371fa5978548 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-1488ac96-7c38-4efb-b220-371fa5978548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:21.090456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:21.091569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:21.093657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:21.093657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:21.093657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:21.093657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 246/492] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:21.093657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ac96-7c38-4efb-b220-371fa5978548 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.178934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282a799-4cb0-43fd-b5cb-4d9dbfff9b60 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.196124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.200937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ac96-7c38-4efb-b220-371fa5978548 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.215165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359ea7b-3b30-4e93-bd28-4366e5f35d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.215990 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359ea7b-3b30-4e93-bd28-4366e5f35d87 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.216341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359ea7b-3b30-4e93-bd28-4366e5f35d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.216734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359ea7b-3b30-4e93-bd28-4366e5f35d87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.228444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359ea7b-3b30-4e93-bd28-4366e5f35d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-9359ea7b-3b30-4e93-bd28-4366e5f35d87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:21.234690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:21.235770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:21.236571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 247/493] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:21.237257 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359ea7b-3b30-4e93-bd28-4366e5f35d87 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.241166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9474df-0f4f-4e14-af7f-0ea6244072b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.241979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9474df-0f4f-4e14-af7f-0ea6244072b6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.242433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9474df-0f4f-4e14-af7f-0ea6244072b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.242886 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9474df-0f4f-4e14-af7f-0ea6244072b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.243689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9474df-0f4f-4e14-af7f-0ea6244072b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:21.244156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9474df-0f4f-4e14-af7f-0ea6244072b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.245818 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9474df-0f4f-4e14-af7f-0ea6244072b6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.255895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.259659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 247/494] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:21.260521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9474df-0f4f-4e14-af7f-0ea6244072b6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.347961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359ea7b-3b30-4e93-bd28-4366e5f35d87 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.376204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9474df-0f4f-4e14-af7f-0ea6244072b6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.381254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fabb28-1345-449a-bfd7-6f609973fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.381860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fabb28-1345-449a-bfd7-6f609973fe64 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.382152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fabb28-1345-449a-bfd7-6f609973fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.382398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fabb28-1345-449a-bfd7-6f609973fe64 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.383032 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fabb28-1345-449a-bfd7-6f609973fe64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:21.383328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fabb28-1345-449a-bfd7-6f609973fe64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.384734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fabb28-1345-449a-bfd7-6f609973fe64 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.401660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 248/495] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:21.402485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fabb28-1345-449a-bfd7-6f609973fe64 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.418040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721671c2-fe25-46e6-bb92-38c2b468778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.418682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721671c2-fe25-46e6-bb92-38c2b468778b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.418955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721671c2-fe25-46e6-bb92-38c2b468778b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.419228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721671c2-fe25-46e6-bb92-38c2b468778b None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.419890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721671c2-fe25-46e6-bb92-38c2b468778b None admin] RBAC: Adding query filter params (name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:21.420474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721671c2-fe25-46e6-bb92-38c2b468778b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.422472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721671c2-fe25-46e6-bb92-38c2b468778b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.432789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 248/496] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:21.434005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fcab2-0def-48b2-8ba8-01b16ca72f44 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.434289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fcab2-0def-48b2-8ba8-01b16ca72f44 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.434559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fcab2-0def-48b2-8ba8-01b16ca72f44 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.435915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 249/497] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:21.441409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fcab2-0def-48b2-8ba8-01b16ca72f44 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.448871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.506850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.517999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fabb28-1345-449a-bfd7-6f609973fe64 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.551657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fcab2-0def-48b2-8ba8-01b16ca72f44 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.554856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922dbc0-f42c-4a77-8c46-6be40b30b9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.555702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922dbc0-f42c-4a77-8c46-6be40b30b9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.556195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922dbc0-f42c-4a77-8c46-6be40b30b9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.556650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922dbc0-f42c-4a77-8c46-6be40b30b9e3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.565228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922dbc0-f42c-4a77-8c46-6be40b30b9e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.567007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922dbc0-f42c-4a77-8c46-6be40b30b9e3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-0922dbc0-f42c-4a77-8c46-6be40b30b9e3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:21.582123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:21.583042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:21.583922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:21.583922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:21.583922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:21.583922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:21.583922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:21.583922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:21.583922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:21.583922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:21.583922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:21.583922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:21.590087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 249/498] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:21.590087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922dbc0-f42c-4a77-8c46-6be40b30b9e3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.590685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201f8c-b40b-4369-9319-3448c61159d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.591359 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201f8c-b40b-4369-9319-3448c61159d5 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.591641 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201f8c-b40b-4369-9319-3448c61159d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.591937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201f8c-b40b-4369-9319-3448c61159d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.600709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23201f8c-b40b-4369-9319-3448c61159d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.602243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23201f8c-b40b-4369-9319-3448c61159d5 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-23201f8c-b40b-4369-9319-3448c61159d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:21.615685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:21.616564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:21.617585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 250/499] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:21.618132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859b451-0dbd-40ea-aa54-9a45830501b7 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.618195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859b451-0dbd-40ea-aa54-9a45830501b7 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.618904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859b451-0dbd-40ea-aa54-9a45830501b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.637443 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-b859b451-0dbd-40ea-aa54-9a45830501b7 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:21.638667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b859b451-0dbd-40ea-aa54-9a45830501b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:21.700482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.707571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922dbc0-f42c-4a77-8c46-6be40b30b9e3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.720651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 251/500] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:21.720651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859b451-0dbd-40ea-aa54-9a45830501b7 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.746141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81ca49-c233-495f-a0ba-89ba5bf4e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.746929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81ca49-c233-495f-a0ba-89ba5bf4e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.747208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81ca49-c233-495f-a0ba-89ba5bf4e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.747478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81ca49-c233-495f-a0ba-89ba5bf4e0b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.759369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81ca49-c233-495f-a0ba-89ba5bf4e0b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.760876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81ca49-c233-495f-a0ba-89ba5bf4e0b4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-bb81ca49-c233-495f-a0ba-89ba5bf4e0b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:21.776026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:21.777213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:21.778041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:21.778041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:21.778041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:21.779243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.782494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 250/501] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:21.783307 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81ca49-c233-495f-a0ba-89ba5bf4e0b4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.829071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859b451-0dbd-40ea-aa54-9a45830501b7 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.863309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077df88-f0f2-4044-b3b2-23ddb6cb074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.863914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077df88-f0f2-4044-b3b2-23ddb6cb074b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.864193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077df88-f0f2-4044-b3b2-23ddb6cb074b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.864461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077df88-f0f2-4044-b3b2-23ddb6cb074b None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.865210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077df88-f0f2-4044-b3b2-23ddb6cb074b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:21.865513 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077df88-f0f2-4044-b3b2-23ddb6cb074b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.866956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077df88-f0f2-4044-b3b2-23ddb6cb074b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.884316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81ca49-c233-495f-a0ba-89ba5bf4e0b4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.901669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 252/502] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:21.902479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077df88-f0f2-4044-b3b2-23ddb6cb074b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.919565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4aeb9-780a-4507-942c-8878ccbfa1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.920165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4aeb9-780a-4507-942c-8878ccbfa1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.920443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4aeb9-780a-4507-942c-8878ccbfa1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.920816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4aeb9-780a-4507-942c-8878ccbfa1a5 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.922135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4aeb9-780a-4507-942c-8878ccbfa1a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:21.922441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4aeb9-780a-4507-942c-8878ccbfa1a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.924119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4aeb9-780a-4507-942c-8878ccbfa1a5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.959813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 251/503] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:21.960553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4aeb9-780a-4507-942c-8878ccbfa1a5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.969251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.005532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077df88-f0f2-4044-b3b2-23ddb6cb074b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.016489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.039964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5cf10-ea85-47ed-b006-62084bba8712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.040589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5cf10-ea85-47ed-b006-62084bba8712 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.040895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5cf10-ea85-47ed-b006-62084bba8712 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.041158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5cf10-ea85-47ed-b006-62084bba8712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.051191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5cf10-ea85-47ed-b006-62084bba8712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.052677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5cf10-ea85-47ed-b006-62084bba8712 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.060474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4aeb9-780a-4507-942c-8878ccbfa1a5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-b5d5cf10-ea85-47ed-b006-62084bba8712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:22.067457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:22.068523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:22.069565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:22.069565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:22.069565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:22.069565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 253/504] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:22.069827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0462d-828c-4ff3-a05e-25732e86ba0d None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.070010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0462d-828c-4ff3-a05e-25732e86ba0d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.070283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0462d-828c-4ff3-a05e-25732e86ba0d None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.071685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 254/505] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:22.072280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0462d-828c-4ff3-a05e-25732e86ba0d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.099496 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ab82a-c9d4-49da-adbc-20a9834f2578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.100102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ab82a-c9d4-49da-adbc-20a9834f2578 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.100376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ab82a-c9d4-49da-adbc-20a9834f2578 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.100664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ab82a-c9d4-49da-adbc-20a9834f2578 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.101301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ab82a-c9d4-49da-adbc-20a9834f2578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:22.101602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ab82a-c9d4-49da-adbc-20a9834f2578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.102966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ab82a-c9d4-49da-adbc-20a9834f2578 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.114255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 252/506] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:22.115034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ab82a-c9d4-49da-adbc-20a9834f2578 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.176476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0462d-828c-4ff3-a05e-25732e86ba0d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.179518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.210754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ab125-8222-4ac2-b9e1-8d68d6d10885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.211277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab125-8222-4ac2-b9e1-8d68d6d10885 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.211559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab125-8222-4ac2-b9e1-8d68d6d10885 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.211823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab125-8222-4ac2-b9e1-8d68d6d10885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.215021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ab82a-c9d4-49da-adbc-20a9834f2578 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.241287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.248320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942fe4b-c47f-4996-91ff-d82485149f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.249647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942fe4b-c47f-4996-91ff-d82485149f51 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.250142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942fe4b-c47f-4996-91ff-d82485149f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.250423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942fe4b-c47f-4996-91ff-d82485149f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.278856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ab125-8222-4ac2-b9e1-8d68d6d10885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.280343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ab125-8222-4ac2-b9e1-8d68d6d10885 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.317764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942fe4b-c47f-4996-91ff-d82485149f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.319507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942fe4b-c47f-4996-91ff-d82485149f51 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.378640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 255/507] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:22.381429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.383981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ab125-8222-4ac2-b9e1-8d68d6d10885 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.420257 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 253/508] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:22.421586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c681434-01bc-4539-9c16-097fffc94e80 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.421873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c681434-01bc-4539-9c16-097fffc94e80 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.422142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c681434-01bc-4539-9c16-097fffc94e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.446206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3c681434-01bc-4539-9c16-097fffc94e80 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:22.446795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.447390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3c681434-01bc-4539-9c16-097fffc94e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:22.488564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ab125-8222-4ac2-b9e1-8d68d6d10885 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.517617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 254/509] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:22.518444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c681434-01bc-4539-9c16-097fffc94e80 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.531809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ea75-2163-46ad-ad5a-a1189c7a9034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.532406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ea75-2163-46ad-ad5a-a1189c7a9034 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.532708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ea75-2163-46ad-ad5a-a1189c7a9034 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.532975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ea75-2163-46ad-ad5a-a1189c7a9034 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.533609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ea75-2163-46ad-ad5a-a1189c7a9034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:22.533903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ea75-2163-46ad-ad5a-a1189c7a9034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.535261 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ea75-2163-46ad-ad5a-a1189c7a9034 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.546714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 256/510] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:22.547715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ea75-2163-46ad-ad5a-a1189c7a9034 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.611705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.618247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c681434-01bc-4539-9c16-097fffc94e80 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.647949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ea75-2163-46ad-ad5a-a1189c7a9034 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.651828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed221-225a-436b-8ab7-9aec6654ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.652475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed221-225a-436b-8ab7-9aec6654ce41 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.652782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed221-225a-436b-8ab7-9aec6654ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.653052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed221-225a-436b-8ab7-9aec6654ce41 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.660129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bed221-225a-436b-8ab7-9aec6654ce41 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.661592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bed221-225a-436b-8ab7-9aec6654ce41 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.670466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f2bed221-225a-436b-8ab7-9aec6654ce41 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:22.673162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:22.674299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 255/511] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:22.675234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed221-225a-436b-8ab7-9aec6654ce41 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.684606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267b4cc-0aff-416a-bd50-0afded861eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.685260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267b4cc-0aff-416a-bd50-0afded861eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.685535 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267b4cc-0aff-416a-bd50-0afded861eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.685800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267b4cc-0aff-416a-bd50-0afded861eb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.697047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267b4cc-0aff-416a-bd50-0afded861eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.698495 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267b4cc-0aff-416a-bd50-0afded861eb7 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-2267b4cc-0aff-416a-bd50-0afded861eb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:22.712794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:22.713834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:22.714885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:22.714885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:22.714885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:22.714885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 257/512] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:22.714885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267b4cc-0aff-416a-bd50-0afded861eb7 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.776829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed221-225a-436b-8ab7-9aec6654ce41 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.809705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4ba3-57a2-4a1f-864e-4744584149d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.810402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4ba3-57a2-4a1f-864e-4744584149d5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.810676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4ba3-57a2-4a1f-864e-4744584149d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.810941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4ba3-57a2-4a1f-864e-4744584149d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.812405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267b4cc-0aff-416a-bd50-0afded861eb7 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.821543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b4ba3-57a2-4a1f-864e-4744584149d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.823267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b4ba3-57a2-4a1f-864e-4744584149d5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-979b4ba3-57a2-4a1f-864e-4744584149d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:22.837477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:22.838396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:22.839247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:22.839247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:22.839247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:22.839247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 256/513] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:22.839457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4ba3-57a2-4a1f-864e-4744584149d5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.850446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.851835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b770d-c885-4d8c-927f-4f85363851ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.852582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b770d-c885-4d8c-927f-4f85363851ac None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.852898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b770d-c885-4d8c-927f-4f85363851ac None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.853166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b770d-c885-4d8c-927f-4f85363851ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.863160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b770d-c885-4d8c-927f-4f85363851ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-dd2b770d-c885-4d8c-927f-4f85363851ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:22.868201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:22.869229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:22.870044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 258/514] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:22.870686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b770d-c885-4d8c-927f-4f85363851ac None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.903518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.944283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4ba3-57a2-4a1f-864e-4744584149d5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.971547 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b770d-c885-4d8c-927f-4f85363851ac None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.977978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c74e39-0256-4e85-bf70-579a876659e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.978578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c74e39-0256-4e85-bf70-579a876659e2 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.978854 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c74e39-0256-4e85-bf70-579a876659e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.979125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c74e39-0256-4e85-bf70-579a876659e2 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.979756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c74e39-0256-4e85-bf70-579a876659e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.981225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c74e39-0256-4e85-bf70-579a876659e2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.002238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 257/515] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:22 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:23.002973 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c74e39-0256-4e85-bf70-579a876659e2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.011583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982f6f8-e93c-436e-98c2-2824f0ccc1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:23.012218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f6f8-e93c-436e-98c2-2824f0ccc1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:23.012494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f6f8-e93c-436e-98c2-2824f0ccc1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:23.012796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f6f8-e93c-436e-98c2-2824f0ccc1d9 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:23.013537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982f6f8-e93c-436e-98c2-2824f0ccc1d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:23.013843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982f6f8-e93c-436e-98c2-2824f0ccc1d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:23.015989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982f6f8-e93c-436e-98c2-2824f0ccc1d9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.040248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 259/516] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:23.041599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982f6f8-e93c-436e-98c2-2824f0ccc1d9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.082514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:23.126186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c74e39-0256-4e85-bf70-579a876659e2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:23.150316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:23.162333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d63ed-c706-4105-a318-e00c05aee09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:23.162691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982f6f8-e93c-436e-98c2-2824f0ccc1d9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:23.162951 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d63ed-c706-4105-a318-e00c05aee09e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:23.163227 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d63ed-c706-4105-a318-e00c05aee09e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:23.163497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d63ed-c706-4105-a318-e00c05aee09e None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:23.164142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d63ed-c706-4105-a318-e00c05aee09e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:23.164440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d63ed-c706-4105-a318-e00c05aee09e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:23.165854 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d63ed-c706-4105-a318-e00c05aee09e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.180549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 258/517] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:23.181583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d63ed-c706-4105-a318-e00c05aee09e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.203312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d7764-9eae-49fe-9a77-c14e6ce97b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:23.203932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d7764-9eae-49fe-9a77-c14e6ce97b42 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:23.204210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d7764-9eae-49fe-9a77-c14e6ce97b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:23.204480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d7764-9eae-49fe-9a77-c14e6ce97b42 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:23.205169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d7764-9eae-49fe-9a77-c14e6ce97b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:23.205471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d7764-9eae-49fe-9a77-c14e6ce97b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:23.206966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d7764-9eae-49fe-9a77-c14e6ce97b42 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.219724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 260/518] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:23.220725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d7764-9eae-49fe-9a77-c14e6ce97b42 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.296026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d63ed-c706-4105-a318-e00c05aee09e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:23.320187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:23.330923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d7764-9eae-49fe-9a77-c14e6ce97b42 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:23.331843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288827c6-e702-4266-b54d-a073841c7873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:23.332448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288827c6-e702-4266-b54d-a073841c7873 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:23.332754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288827c6-e702-4266-b54d-a073841c7873 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:23.333024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288827c6-e702-4266-b54d-a073841c7873 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:23.333686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288827c6-e702-4266-b54d-a073841c7873 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:23.333986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288827c6-e702-4266-b54d-a073841c7873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:23.335342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288827c6-e702-4266-b54d-a073841c7873 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.348140 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 259/519] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:23.348140 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288827c6-e702-4266-b54d-a073841c7873 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.373452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ed16f-865f-4293-bb44-ddc8e079d8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:23.375195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ed16f-865f-4293-bb44-ddc8e079d8ff None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:23.375622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ed16f-865f-4293-bb44-ddc8e079d8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:23.376033 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ed16f-865f-4293-bb44-ddc8e079d8ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:23.403183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:23.456541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ed16f-865f-4293-bb44-ddc8e079d8ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:23.457118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288827c6-e702-4266-b54d-a073841c7873 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:23.458030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ed16f-865f-4293-bb44-ddc8e079d8ff None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.494071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01474a00-f35c-40bd-9658-a27299fe37d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:23.494969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01474a00-f35c-40bd-9658-a27299fe37d2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:23.495649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01474a00-f35c-40bd-9658-a27299fe37d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:23.495935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01474a00-f35c-40bd-9658-a27299fe37d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:23.503869 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01474a00-f35c-40bd-9658-a27299fe37d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:23.505068 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01474a00-f35c-40bd-9658-a27299fe37d2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-01474a00-f35c-40bd-9658-a27299fe37d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:23.523207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:23.524215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:23.525283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:23.525283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:23.525283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:23.525283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:23.525283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:23.525283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:23.525283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:23.525283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:23.526288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 260/520] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:23.527050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01474a00-f35c-40bd-9658-a27299fe37d2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.570367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 261/521] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:23.571519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ed16f-865f-4293-bb44-ddc8e079d8ff None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.579355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:23.626240 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:23.638191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01474a00-f35c-40bd-9658-a27299fe37d2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:23.672728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18dd81-3137-4d11-a78e-f780d94ae9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:23.673607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18dd81-3137-4d11-a78e-f780d94ae9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:23.673885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18dd81-3137-4d11-a78e-f780d94ae9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:23.674152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18dd81-3137-4d11-a78e-f780d94ae9d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:23.675626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ed16f-865f-4293-bb44-ddc8e079d8ff None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:23.680803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18dd81-3137-4d11-a78e-f780d94ae9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:23.682250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18dd81-3137-4d11-a78e-f780d94ae9d4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-df18dd81-3137-4d11-a78e-f780d94ae9d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:23.693813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:23.694664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:23.695522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:23.695522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:23.695522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:23.695522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:23.695522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:23.695522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:23.695522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:23.695522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:23.695522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 261/522] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:23.695980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18dd81-3137-4d11-a78e-f780d94ae9d4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.714535 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec51e4-c4e8-4ba8-a17b-e25706c2badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:23.715156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec51e4-c4e8-4ba8-a17b-e25706c2badb None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:23.715542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec51e4-c4e8-4ba8-a17b-e25706c2badb None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:23.715809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec51e4-c4e8-4ba8-a17b-e25706c2badb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:23.726292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec51e4-c4e8-4ba8-a17b-e25706c2badb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:23.727749 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec51e4-c4e8-4ba8-a17b-e25706c2badb None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-a4ec51e4-c4e8-4ba8-a17b-e25706c2badb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:23.743562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:23.744527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:23.745708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:23.745708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:23.745708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:23.745708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 262/523] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:23.745708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec51e4-c4e8-4ba8-a17b-e25706c2badb None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.804203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18dd81-3137-4d11-a78e-f780d94ae9d4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:23.811060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:23.839817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674999a-9672-4da7-ac49-1acf1f283033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:23.840333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674999a-9672-4da7-ac49-1acf1f283033 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:23.840609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674999a-9672-4da7-ac49-1acf1f283033 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:23.840901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674999a-9672-4da7-ac49-1acf1f283033 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:23.841995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674999a-9672-4da7-ac49-1acf1f283033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:23.842318 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674999a-9672-4da7-ac49-1acf1f283033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:23.844440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674999a-9672-4da7-ac49-1acf1f283033 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.855301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec51e4-c4e8-4ba8-a17b-e25706c2badb None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:23.858476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:23.861710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 262/524] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:23.862677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674999a-9672-4da7-ac49-1acf1f283033 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.898001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7198ff-459f-4ddf-a6fe-707978ceac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:23.898751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7198ff-459f-4ddf-a6fe-707978ceac6b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:23.899109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7198ff-459f-4ddf-a6fe-707978ceac6b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:23.899380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7198ff-459f-4ddf-a6fe-707978ceac6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:23.910535 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7198ff-459f-4ddf-a6fe-707978ceac6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:23.912062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7198ff-459f-4ddf-a6fe-707978ceac6b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-8b7198ff-459f-4ddf-a6fe-707978ceac6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:23.927638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:23.928768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:23.934260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:23.934260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:23.934260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:23.934260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 263/525] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:23.934260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7198ff-459f-4ddf-a6fe-707978ceac6b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:23.976010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674999a-9672-4da7-ac49-1acf1f283033 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.009847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193132eb-8dcd-4900-bb71-337655681853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.010447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193132eb-8dcd-4900-bb71-337655681853 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.010719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193132eb-8dcd-4900-bb71-337655681853 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.010981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193132eb-8dcd-4900-bb71-337655681853 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.011651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193132eb-8dcd-4900-bb71-337655681853 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:24.011949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193132eb-8dcd-4900-bb71-337655681853 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.013401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193132eb-8dcd-4900-bb71-337655681853 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.030398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 263/526] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:24.030398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193132eb-8dcd-4900-bb71-337655681853 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.046569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7198ff-459f-4ddf-a6fe-707978ceac6b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.059700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:24.089036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d280a5-42c5-4349-aca2-147c88334988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.089640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d280a5-42c5-4349-aca2-147c88334988 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.089966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d280a5-42c5-4349-aca2-147c88334988 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.090185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d280a5-42c5-4349-aca2-147c88334988 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.090819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d280a5-42c5-4349-aca2-147c88334988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:24.091116 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d280a5-42c5-4349-aca2-147c88334988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.092512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d280a5-42c5-4349-aca2-147c88334988 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.108659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 264/527] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:24.108659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d280a5-42c5-4349-aca2-147c88334988 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.124916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:24.146585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193132eb-8dcd-4900-bb71-337655681853 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.188504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa998418-9030-4a55-a06f-9a8199d81a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.189158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa998418-9030-4a55-a06f-9a8199d81a09 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.189439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa998418-9030-4a55-a06f-9a8199d81a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.189709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa998418-9030-4a55-a06f-9a8199d81a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.190780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa998418-9030-4a55-a06f-9a8199d81a09 None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=79efccae1afa46e78c25f617bf2dd9dd) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:24.190780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa998418-9030-4a55-a06f-9a8199d81a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.192122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa998418-9030-4a55-a06f-9a8199d81a09 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.204688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 264/528] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/role_assignments?user.id=79efccae1afa46e78c25f617bf2dd9dd&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:24.204688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa998418-9030-4a55-a06f-9a8199d81a09 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.239046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d280a5-42c5-4349-aca2-147c88334988 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.297207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02c00-c7c4-4a33-bb3c-9f0f4b05f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.298672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02c00-c7c4-4a33-bb3c-9f0f4b05f987 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.299089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02c00-c7c4-4a33-bb3c-9f0f4b05f987 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.299523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02c00-c7c4-4a33-bb3c-9f0f4b05f987 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.300570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff02c00-c7c4-4a33-bb3c-9f0f4b05f987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:24.301536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff02c00-c7c4-4a33-bb3c-9f0f4b05f987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.303087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff02c00-c7c4-4a33-bb3c-9f0f4b05f987 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.310160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:24.321692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 265/529] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:24.322851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02c00-c7c4-4a33-bb3c-9f0f4b05f987 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.329148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa998418-9030-4a55-a06f-9a8199d81a09 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.371152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aed562-21a1-45e3-ba2b-3286598ce06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.371761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aed562-21a1-45e3-ba2b-3286598ce06a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.372035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aed562-21a1-45e3-ba2b-3286598ce06a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.372299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aed562-21a1-45e3-ba2b-3286598ce06a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.373060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aed562-21a1-45e3-ba2b-3286598ce06a None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=98925192a33544e081f1a02faed60b7f) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:24.373363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aed562-21a1-45e3-ba2b-3286598ce06a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.375076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aed562-21a1-45e3-ba2b-3286598ce06a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.384678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 265/530] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/role_assignments?user.id=98925192a33544e081f1a02faed60b7f&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:24.384678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aed562-21a1-45e3-ba2b-3286598ce06a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.471320 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:24.519550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02c00-c7c4-4a33-bb3c-9f0f4b05f987 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.577201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aed562-21a1-45e3-ba2b-3286598ce06a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.577446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f034fae-0752-452c-b01c-740d75c63ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.577907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f034fae-0752-452c-b01c-740d75c63ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.578227 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f034fae-0752-452c-b01c-740d75c63ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.578500 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f034fae-0752-452c-b01c-740d75c63ab9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.586551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f034fae-0752-452c-b01c-740d75c63ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.587987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f034fae-0752-452c-b01c-740d75c63ab9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-9f034fae-0752-452c-b01c-740d75c63ab9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:24.604228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:24.605222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:24.606099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 266/531] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:24.611677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f034fae-0752-452c-b01c-740d75c63ab9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.619656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a36bb5-0fb6-43be-a04d-c48f36b4b4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.620565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a36bb5-0fb6-43be-a04d-c48f36b4b4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.621114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a36bb5-0fb6-43be-a04d-c48f36b4b4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.621636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a36bb5-0fb6-43be-a04d-c48f36b4b4f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.629764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a36bb5-0fb6-43be-a04d-c48f36b4b4f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.631568 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a36bb5-0fb6-43be-a04d-c48f36b4b4f0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-34a36bb5-0fb6-43be-a04d-c48f36b4b4f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:24.644371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:24.645286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:24.646129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:24.646129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:24.646129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:24.646129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:24.646129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:24.646129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:24.646129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:24.646129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:24.648475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 266/532] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:24.654219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a36bb5-0fb6-43be-a04d-c48f36b4b4f0 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.672406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:24.808754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f034fae-0752-452c-b01c-740d75c63ab9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.832345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a36bb5-0fb6-43be-a04d-c48f36b4b4f0 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.871547 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a5cb-8b4e-4638-9f31-182bafb5a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.872555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a5cb-8b4e-4638-9f31-182bafb5a274 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.873051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a5cb-8b4e-4638-9f31-182bafb5a274 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.873517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a5cb-8b4e-4638-9f31-182bafb5a274 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.874651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a5cb-8b4e-4638-9f31-182bafb5a274 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:24.875153 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a5cb-8b4e-4638-9f31-182bafb5a274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.876903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a5cb-8b4e-4638-9f31-182bafb5a274 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.884708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:24.897829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 267/533] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:24.904745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a5cb-8b4e-4638-9f31-182bafb5a274 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.917346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10c692-c291-404e-9da3-570c51f67763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.917998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10c692-c291-404e-9da3-570c51f67763 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.918394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10c692-c291-404e-9da3-570c51f67763 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.918509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10c692-c291-404e-9da3-570c51f67763 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.919187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10c692-c291-404e-9da3-570c51f67763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:24.919574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10c692-c291-404e-9da3-570c51f67763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.921637 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10c692-c291-404e-9da3-570c51f67763 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.951123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 267/534] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:24.956811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10c692-c291-404e-9da3-570c51f67763 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.062648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a5cb-8b4e-4638-9f31-182bafb5a274 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.071703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.094247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10c692-c291-404e-9da3-570c51f67763 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.130110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c673ee0-30cb-48eb-aec2-5e4abb940afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.130927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c673ee0-30cb-48eb-aec2-5e4abb940afe None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.131580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c673ee0-30cb-48eb-aec2-5e4abb940afe None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.132052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c673ee0-30cb-48eb-aec2-5e4abb940afe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.132935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c673ee0-30cb-48eb-aec2-5e4abb940afe None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=f0b215bfb43742678bd5a728973dbc46) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:25.133487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c673ee0-30cb-48eb-aec2-5e4abb940afe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:25.135044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c673ee0-30cb-48eb-aec2-5e4abb940afe None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:25.142405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 268/535] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/role_assignments?user.id=f0b215bfb43742678bd5a728973dbc46&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:25.152425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1670b3-c010-4d65-b6eb-dc186a7eb89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.153344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1670b3-c010-4d65-b6eb-dc186a7eb89b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.153759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1670b3-c010-4d65-b6eb-dc186a7eb89b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.154160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1670b3-c010-4d65-b6eb-dc186a7eb89b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.167243 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d392-78a5-4b04-aeb6-f7e9c9b01382 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.167560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d392-78a5-4b04-aeb6-f7e9c9b01382 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.167781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d392-78a5-4b04-aeb6-f7e9c9b01382 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.169597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 269/536] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:25.180708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed629ed3-4e2a-497f-9c27-d111b0852d6d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.180931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed629ed3-4e2a-497f-9c27-d111b0852d6d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.181193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed629ed3-4e2a-497f-9c27-d111b0852d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.223807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ed629ed3-4e2a-497f-9c27-d111b0852d6d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:25.225182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ed629ed3-4e2a-497f-9c27-d111b0852d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:25.229345 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.237457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1670b3-c010-4d65-b6eb-dc186a7eb89b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:25.239415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1670b3-c010-4d65-b6eb-dc186a7eb89b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:25.361270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 270/537] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:25.394337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed629ed3-4e2a-497f-9c27-d111b0852d6d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.414467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 268/538] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:25.419703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1670b3-c010-4d65-b6eb-dc186a7eb89b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.507911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.563648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.567367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed629ed3-4e2a-497f-9c27-d111b0852d6d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.574943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1670b3-c010-4d65-b6eb-dc186a7eb89b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.633417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad54a8-83bb-4b30-8af8-79842f3eb288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.634054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad54a8-83bb-4b30-8af8-79842f3eb288 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.634326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad54a8-83bb-4b30-8af8-79842f3eb288 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.634594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad54a8-83bb-4b30-8af8-79842f3eb288 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.640545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28dc2d-7bea-42b2-9023-7dddb314c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.641260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28dc2d-7bea-42b2-9023-7dddb314c4cf None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.641532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28dc2d-7bea-42b2-9023-7dddb314c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.641933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28dc2d-7bea-42b2-9023-7dddb314c4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.656902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad54a8-83bb-4b30-8af8-79842f3eb288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ffad54a8-83bb-4b30-8af8-79842f3eb288 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:25.662826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:25.663918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:25.664982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 271/539] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:25.670150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad54a8-83bb-4b30-8af8-79842f3eb288 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.670961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28dc2d-7bea-42b2-9023-7dddb314c4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:25.673195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28dc2d-7bea-42b2-9023-7dddb314c4cf None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-7a28dc2d-7bea-42b2-9023-7dddb314c4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:25.700679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:25.703170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:25.705216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:25.705216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:25.705216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:25.707131 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 269/540] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:25.712143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28dc2d-7bea-42b2-9023-7dddb314c4cf None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.832042 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28dc2d-7bea-42b2-9023-7dddb314c4cf None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.869004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec9b3f-8173-41b7-8cac-9a269a917284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.869668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec9b3f-8173-41b7-8cac-9a269a917284 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.869978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec9b3f-8173-41b7-8cac-9a269a917284 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.870255 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec9b3f-8173-41b7-8cac-9a269a917284 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.871003 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec9b3f-8173-41b7-8cac-9a269a917284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:25.871308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec9b3f-8173-41b7-8cac-9a269a917284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:25.872868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec9b3f-8173-41b7-8cac-9a269a917284 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:25.886657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 270/541] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:25.892593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec9b3f-8173-41b7-8cac-9a269a917284 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.894383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad54a8-83bb-4b30-8af8-79842f3eb288 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.905014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.939500 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.956652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50520a-a521-4c54-bd88-1e36f21b5671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.957284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50520a-a521-4c54-bd88-1e36f21b5671 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.957561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50520a-a521-4c54-bd88-1e36f21b5671 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.957833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50520a-a521-4c54-bd88-1e36f21b5671 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.958493 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50520a-a521-4c54-bd88-1e36f21b5671 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:25.958793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50520a-a521-4c54-bd88-1e36f21b5671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:25.960435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50520a-a521-4c54-bd88-1e36f21b5671 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:25.988793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 272/542] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:25.991715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50520a-a521-4c54-bd88-1e36f21b5671 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.073363 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec9b3f-8173-41b7-8cac-9a269a917284 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.138769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b1c4-7478-4743-8a40-5023315ec7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.139493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b1c4-7478-4743-8a40-5023315ec7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.139846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b1c4-7478-4743-8a40-5023315ec7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.140121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b1c4-7478-4743-8a40-5023315ec7f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.152828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50520a-a521-4c54-bd88-1e36f21b5671 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.161701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880b1c4-7478-4743-8a40-5023315ec7f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.163310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880b1c4-7478-4743-8a40-5023315ec7f3 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-f880b1c4-7478-4743-8a40-5023315ec7f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:26.180415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:26.181292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:26.182526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:26.182526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:26.182526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:26.182526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:26.182526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:26.182526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:26.182526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:26.182526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:26.182526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 271/543] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:26.188534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b1c4-7478-4743-8a40-5023315ec7f3 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.190940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f50b6-9678-47cb-994b-cd67296c8b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.191587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f50b6-9678-47cb-994b-cd67296c8b40 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.191868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f50b6-9678-47cb-994b-cd67296c8b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.192143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f50b6-9678-47cb-994b-cd67296c8b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.203457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f50b6-9678-47cb-994b-cd67296c8b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.205062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f50b6-9678-47cb-994b-cd67296c8b40 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-462f50b6-9678-47cb-994b-cd67296c8b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:26.220517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:26.222688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:26.225214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:26.225214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:26.225214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:26.225214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 273/544] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:26.228644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f50b6-9678-47cb-994b-cd67296c8b40 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.272931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.328220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.337100 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f50b6-9678-47cb-994b-cd67296c8b40 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.374285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8abea-67c5-48c2-8d4e-75c11b589e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.375019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8abea-67c5-48c2-8d4e-75c11b589e8b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.375294 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8abea-67c5-48c2-8d4e-75c11b589e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.375665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8abea-67c5-48c2-8d4e-75c11b589e8b None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.376310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8abea-67c5-48c2-8d4e-75c11b589e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:26.376616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8abea-67c5-48c2-8d4e-75c11b589e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.378128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8abea-67c5-48c2-8d4e-75c11b589e8b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.384967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b1c4-7478-4743-8a40-5023315ec7f3 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.391262 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 274/545] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:26.402212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8abea-67c5-48c2-8d4e-75c11b589e8b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.422165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd4ab8-e4b7-4429-a5e5-1e39edcea7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.424000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd4ab8-e4b7-4429-a5e5-1e39edcea7bf None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.424807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd4ab8-e4b7-4429-a5e5-1e39edcea7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.425808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd4ab8-e4b7-4429-a5e5-1e39edcea7bf None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.426984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd4ab8-e4b7-4429-a5e5-1e39edcea7bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:26.427506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd4ab8-e4b7-4429-a5e5-1e39edcea7bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.429813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd4ab8-e4b7-4429-a5e5-1e39edcea7bf None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.466337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 272/546] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:26.470823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd4ab8-e4b7-4429-a5e5-1e39edcea7bf None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.590411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8abea-67c5-48c2-8d4e-75c11b589e8b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.593758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.645281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd4ab8-e4b7-4429-a5e5-1e39edcea7bf None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.647504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b011bf-4819-4b22-bcd5-99d05faeb7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.648353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b011bf-4819-4b22-bcd5-99d05faeb7ea None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.648861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b011bf-4819-4b22-bcd5-99d05faeb7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.649329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b011bf-4819-4b22-bcd5-99d05faeb7ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.657470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b011bf-4819-4b22-bcd5-99d05faeb7ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.659151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b011bf-4819-4b22-bcd5-99d05faeb7ea None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-13b011bf-4819-4b22-bcd5-99d05faeb7ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:26.671795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:26.672737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:26.674315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:26.674315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:26.674315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:26.674315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:26.674315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:26.674315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:26.674315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:26.674315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:26.674315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:26.674315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:26.676883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 275/547] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:26.678282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516fc6e-d067-4303-8500-65c927102b44 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.678761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516fc6e-d067-4303-8500-65c927102b44 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.679243 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516fc6e-d067-4303-8500-65c927102b44 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.681771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 276/548] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:26.682674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516fc6e-d067-4303-8500-65c927102b44 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.684966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.689296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e022f3c-8e25-4f70-a211-95109fd1b403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.690299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022f3c-8e25-4f70-a211-95109fd1b403 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.690666 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022f3c-8e25-4f70-a211-95109fd1b403 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.691049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022f3c-8e25-4f70-a211-95109fd1b403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.691867 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e022f3c-8e25-4f70-a211-95109fd1b403 None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=13063cbf860c4ca98666500c3c125933) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:26.692287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e022f3c-8e25-4f70-a211-95109fd1b403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.693876 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e022f3c-8e25-4f70-a211-95109fd1b403 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.702370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 273/549] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/role_assignments?user.id=13063cbf860c4ca98666500c3c125933&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:26.704194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5893e-e893-4043-b391-006f6b44edc2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.704547 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5893e-e893-4043-b391-006f6b44edc2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.704923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5893e-e893-4043-b391-006f6b44edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.730027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-eae5893e-e893-4043-b391-006f6b44edc2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:26.731506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-eae5893e-e893-4043-b391-006f6b44edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:26.824239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 274/550] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:26.835139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516fc6e-d067-4303-8500-65c927102b44 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.853015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5893e-e893-4043-b391-006f6b44edc2 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.900452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f374f6-c066-4852-9dec-72b0059fb71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.901390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f374f6-c066-4852-9dec-72b0059fb71e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.901869 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f374f6-c066-4852-9dec-72b0059fb71e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.902325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f374f6-c066-4852-9dec-72b0059fb71e None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.903223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f374f6-c066-4852-9dec-72b0059fb71e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:26.903698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f374f6-c066-4852-9dec-72b0059fb71e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.909643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f374f6-c066-4852-9dec-72b0059fb71e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.930334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 277/551] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:26.931620 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2b3b6-8d5f-4b56-ab9f-8b03859381b5 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.931900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2b3b6-8d5f-4b56-ab9f-8b03859381b5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.932170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2b3b6-8d5f-4b56-ab9f-8b03859381b5 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.933728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 278/552] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:26.939464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2b3b6-8d5f-4b56-ab9f-8b03859381b5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.962760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.974047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5893e-e893-4043-b391-006f6b44edc2 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.996602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.013447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bfc9a-209e-4bab-abc7-19862cb88a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.014131 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bfc9a-209e-4bab-abc7-19862cb88a35 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.015282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bfc9a-209e-4bab-abc7-19862cb88a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.015585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bfc9a-209e-4bab-abc7-19862cb88a35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.027101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bfc9a-209e-4bab-abc7-19862cb88a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-390bfc9a-209e-4bab-abc7-19862cb88a35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:27.032524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:27.033556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:27.034452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:27.038679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 275/553] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:27.040580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5802-f964-43dd-9d40-1a376bff1f54 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.040949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5802-f964-43dd-9d40-1a376bff1f54 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.041220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5802-f964-43dd-9d40-1a376bff1f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.047649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2b3b6-8d5f-4b56-ab9f-8b03859381b5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.060460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-157b5802-f964-43dd-9d40-1a376bff1f54 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:27.062362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-157b5802-f964-43dd-9d40-1a376bff1f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:27.084569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bad95e-b063-4fb3-a7d3-1618b21fe78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.085201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bad95e-b063-4fb3-a7d3-1618b21fe78c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.085477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bad95e-b063-4fb3-a7d3-1618b21fe78c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.085742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bad95e-b063-4fb3-a7d3-1618b21fe78c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.137464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 276/554] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:27.138311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b5802-f964-43dd-9d40-1a376bff1f54 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.177435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bad95e-b063-4fb3-a7d3-1618b21fe78c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.178951 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bad95e-b063-4fb3-a7d3-1618b21fe78c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.202529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.252178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b5802-f964-43dd-9d40-1a376bff1f54 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.263373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.287331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 279/555] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:27.288185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bad95e-b063-4fb3-a7d3-1618b21fe78c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.298940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265126e5-2c2f-4ba7-b0a2-0358f2224f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.299995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265126e5-2c2f-4ba7-b0a2-0358f2224f60 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.300269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265126e5-2c2f-4ba7-b0a2-0358f2224f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.300540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265126e5-2c2f-4ba7-b0a2-0358f2224f60 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.301626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265126e5-2c2f-4ba7-b0a2-0358f2224f60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:27.302190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265126e5-2c2f-4ba7-b0a2-0358f2224f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.303813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265126e5-2c2f-4ba7-b0a2-0358f2224f60 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.316719 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 277/556] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:27.317572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265126e5-2c2f-4ba7-b0a2-0358f2224f60 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.425647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bad95e-b063-4fb3-a7d3-1618b21fe78c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.432349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265126e5-2c2f-4ba7-b0a2-0358f2224f60 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.452519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.470969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4dcc5-0de6-4267-ab2a-0cf52526c687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.471174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565e72-2e2c-4cc4-8040-1cea4990bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.471703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565e72-2e2c-4cc4-8040-1cea4990bb56 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.471981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565e72-2e2c-4cc4-8040-1cea4990bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.472270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4dcc5-0de6-4267-ab2a-0cf52526c687 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.472379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565e72-2e2c-4cc4-8040-1cea4990bb56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.472796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4dcc5-0de6-4267-ab2a-0cf52526c687 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.473218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4dcc5-0de6-4267-ab2a-0cf52526c687 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.485847 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9565e72-2e2c-4cc4-8040-1cea4990bb56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.487074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4dcc5-0de6-4267-ab2a-0cf52526c687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:27.487755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9565e72-2e2c-4cc4-8040-1cea4990bb56 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-5ee4dcc5-0de6-4267-ab2a-0cf52526c687 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:27.492938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:27.493927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:27.494750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 280/557] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:27.495436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4dcc5-0de6-4267-ab2a-0cf52526c687 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-c9565e72-2e2c-4cc4-8040-1cea4990bb56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:27.508005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:27.509755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:27.510799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:27.510799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:27.510799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:27.510799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 278/558] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:27.510799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b11d72-4c6f-453f-990a-fa14bb5a0762 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.510799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b11d72-4c6f-453f-990a-fa14bb5a0762 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.510799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b11d72-4c6f-453f-990a-fa14bb5a0762 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.512742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 279/559] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:27.513705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b11d72-4c6f-453f-990a-fa14bb5a0762 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.542259 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.608986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4dcc5-0de6-4267-ab2a-0cf52526c687 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.629477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b11d72-4c6f-453f-990a-fa14bb5a0762 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.642232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a6355-accc-44cd-8968-951ec77172cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.642847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a6355-accc-44cd-8968-951ec77172cf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.643121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a6355-accc-44cd-8968-951ec77172cf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.643385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a6355-accc-44cd-8968-951ec77172cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.655563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a6355-accc-44cd-8968-951ec77172cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.657058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a6355-accc-44cd-8968-951ec77172cf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.670088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96f207-bc7c-4c8a-9ab8-459f969347e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.671384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f207-bc7c-4c8a-9ab8-459f969347e8 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.671846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f207-bc7c-4c8a-9ab8-459f969347e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-650a6355-accc-44cd-8968-951ec77172cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:27.672011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:27.673009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:27.674159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:27.674159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:27.674159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:27.674324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f207-bc7c-4c8a-9ab8-459f969347e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.674324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96f207-bc7c-4c8a-9ab8-459f969347e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:27.674324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96f207-bc7c-4c8a-9ab8-459f969347e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.674948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96f207-bc7c-4c8a-9ab8-459f969347e8 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.678174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 281/560] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:27.679312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d4e1-ca7d-44c5-aae9-bd9440235aad None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.679592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d4e1-ca7d-44c5-aae9-bd9440235aad None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.679865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d4e1-ca7d-44c5-aae9-bd9440235aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.683619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 280/561] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:27.684568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96f207-bc7c-4c8a-9ab8-459f969347e8 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.702373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b373d4e1-ca7d-44c5-aae9-bd9440235aad None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:27.703575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b373d4e1-ca7d-44c5-aae9-bd9440235aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:27.731014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.776766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 282/562] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:27.776766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373d4e1-ca7d-44c5-aae9-bd9440235aad None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.782121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.799966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96f207-bc7c-4c8a-9ab8-459f969347e8 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.834962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95db8b-bbc9-4ffa-96d8-a928d975854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.835558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95db8b-bbc9-4ffa-96d8-a928d975854e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.835832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95db8b-bbc9-4ffa-96d8-a928d975854e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.836096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95db8b-bbc9-4ffa-96d8-a928d975854e None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.836743 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95db8b-bbc9-4ffa-96d8-a928d975854e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:27.837036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95db8b-bbc9-4ffa-96d8-a928d975854e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.838373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95db8b-bbc9-4ffa-96d8-a928d975854e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.854453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 281/563] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:27.854453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95db8b-bbc9-4ffa-96d8-a928d975854e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.897659 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373d4e1-ca7d-44c5-aae9-bd9440235aad None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.932192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242f1c3-e46f-41d8-9be3-c1ba254aae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.932841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242f1c3-e46f-41d8-9be3-c1ba254aae4e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.933125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242f1c3-e46f-41d8-9be3-c1ba254aae4e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.933393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242f1c3-e46f-41d8-9be3-c1ba254aae4e None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.934039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242f1c3-e46f-41d8-9be3-c1ba254aae4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:27.934335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242f1c3-e46f-41d8-9be3-c1ba254aae4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.935739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242f1c3-e46f-41d8-9be3-c1ba254aae4e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.949229 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 283/564] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:27.950092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242f1c3-e46f-41d8-9be3-c1ba254aae4e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.964381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95db8b-bbc9-4ffa-96d8-a928d975854e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.981317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.002724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e6bfc-76dc-4b57-b45c-2ba091819fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.003349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e6bfc-76dc-4b57-b45c-2ba091819fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.003624 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e6bfc-76dc-4b57-b45c-2ba091819fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.003892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e6bfc-76dc-4b57-b45c-2ba091819fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.014615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e6bfc-76dc-4b57-b45c-2ba091819fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.016180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e6bfc-76dc-4b57-b45c-2ba091819fd1 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.022730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-c83e6bfc-76dc-4b57-b45c-2ba091819fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:28.031338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:28.032234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:28.033150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:28.033150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:28.033150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:28.033150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 282/565] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:28.033781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e6bfc-76dc-4b57-b45c-2ba091819fd1 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.065302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242f1c3-e46f-41d8-9be3-c1ba254aae4e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.102680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a50477-c7c2-47f3-bfec-7f19fb337742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.103367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50477-c7c2-47f3-bfec-7f19fb337742 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.103648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50477-c7c2-47f3-bfec-7f19fb337742 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.103915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50477-c7c2-47f3-bfec-7f19fb337742 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.115706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a50477-c7c2-47f3-bfec-7f19fb337742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-05a50477-c7c2-47f3-bfec-7f19fb337742 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:28.120846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:28.121758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:28.122582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 284/566] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:28.123254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a50477-c7c2-47f3-bfec-7f19fb337742 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.145694 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e6bfc-76dc-4b57-b45c-2ba091819fd1 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.181136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2dd65-cd52-45da-be26-accd63805b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.181757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2dd65-cd52-45da-be26-accd63805b1d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.182037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2dd65-cd52-45da-be26-accd63805b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.182309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2dd65-cd52-45da-be26-accd63805b1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.189673 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2dd65-cd52-45da-be26-accd63805b1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.191120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2dd65-cd52-45da-be26-accd63805b1d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-91a2dd65-cd52-45da-be26-accd63805b1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:28.206026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:28.206906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:28.207771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:28.207771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:28.207771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:28.207771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:28.207771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:28.207771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:28.207771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:28.207771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:28.207771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 283/567] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:28.208243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2dd65-cd52-45da-be26-accd63805b1d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.212589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.233264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a50477-c7c2-47f3-bfec-7f19fb337742 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.269052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c8d57-b0fa-4cc1-a9be-967ed5a7512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.270024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c8d57-b0fa-4cc1-a9be-967ed5a7512c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.270533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c8d57-b0fa-4cc1-a9be-967ed5a7512c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.270829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.270954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c8d57-b0fa-4cc1-a9be-967ed5a7512c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.278923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c8d57-b0fa-4cc1-a9be-967ed5a7512c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.281192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c8d57-b0fa-4cc1-a9be-967ed5a7512c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c97c8d57-b0fa-4cc1-a9be-967ed5a7512c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:28.292730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:28.294103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 285/568] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:28.295039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c8d57-b0fa-4cc1-a9be-967ed5a7512c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.321355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2dd65-cd52-45da-be26-accd63805b1d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.359660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a423738-f576-4709-90ad-b38f57ff6272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.360430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423738-f576-4709-90ad-b38f57ff6272 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.360737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423738-f576-4709-90ad-b38f57ff6272 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.361306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423738-f576-4709-90ad-b38f57ff6272 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.361951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a423738-f576-4709-90ad-b38f57ff6272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:28.362258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a423738-f576-4709-90ad-b38f57ff6272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.363649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a423738-f576-4709-90ad-b38f57ff6272 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.380438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 284/569] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:28.380438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a423738-f576-4709-90ad-b38f57ff6272 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.412141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c8d57-b0fa-4cc1-a9be-967ed5a7512c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.447258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793128e5-285b-45e7-afe1-4534452d1c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.447861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793128e5-285b-45e7-afe1-4534452d1c84 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.448141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793128e5-285b-45e7-afe1-4534452d1c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.448406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793128e5-285b-45e7-afe1-4534452d1c84 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.449095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793128e5-285b-45e7-afe1-4534452d1c84 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:28.449401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793128e5-285b-45e7-afe1-4534452d1c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.450769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793128e5-285b-45e7-afe1-4534452d1c84 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.459271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 286/570] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:28.459899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793128e5-285b-45e7-afe1-4534452d1c84 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.464225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.490818 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a423738-f576-4709-90ad-b38f57ff6272 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.511120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.529735 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3d75-57d6-4b7e-bc6e-58cbd5fa6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.530887 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3d75-57d6-4b7e-bc6e-58cbd5fa6b55 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.531163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3d75-57d6-4b7e-bc6e-58cbd5fa6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.531427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3d75-57d6-4b7e-bc6e-58cbd5fa6b55 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.532139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3d75-57d6-4b7e-bc6e-58cbd5fa6b55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:28.532415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3d75-57d6-4b7e-bc6e-58cbd5fa6b55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.533987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3d75-57d6-4b7e-bc6e-58cbd5fa6b55 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.546812 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 285/571] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:28.547559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3d75-57d6-4b7e-bc6e-58cbd5fa6b55 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.577133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793128e5-285b-45e7-afe1-4534452d1c84 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.612641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817180f-618f-418c-b331-a259e1c84f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.613264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817180f-618f-418c-b331-a259e1c84f6a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.613541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817180f-618f-418c-b331-a259e1c84f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.613811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817180f-618f-418c-b331-a259e1c84f6a None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.614525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817180f-618f-418c-b331-a259e1c84f6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:28.614823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817180f-618f-418c-b331-a259e1c84f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.616260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817180f-618f-418c-b331-a259e1c84f6a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.637967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 287/572] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:28.637967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817180f-618f-418c-b331-a259e1c84f6a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.660227 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3d75-57d6-4b7e-bc6e-58cbd5fa6b55 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.694941 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f655069-a7c8-49c8-91b7-c500a8ccb46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.695634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655069-a7c8-49c8-91b7-c500a8ccb46b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.695911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655069-a7c8-49c8-91b7-c500a8ccb46b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.696174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655069-a7c8-49c8-91b7-c500a8ccb46b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.701276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.704917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f655069-a7c8-49c8-91b7-c500a8ccb46b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.706375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f655069-a7c8-49c8-91b7-c500a8ccb46b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-7f655069-a7c8-49c8-91b7-c500a8ccb46b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:28.719229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:28.720431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 286/573] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:28.721416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f655069-a7c8-49c8-91b7-c500a8ccb46b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.749976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817180f-618f-418c-b331-a259e1c84f6a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.767081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.790184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c4ff-1762-486e-8c93-7b3371804108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.791079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c4ff-1762-486e-8c93-7b3371804108 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.791564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c4ff-1762-486e-8c93-7b3371804108 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.792104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c4ff-1762-486e-8c93-7b3371804108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.803130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4c4ff-1762-486e-8c93-7b3371804108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.804500 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4c4ff-1762-486e-8c93-7b3371804108 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-fff4c4ff-1762-486e-8c93-7b3371804108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:28.820477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:28.821482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:28.822359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:28.822359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:28.822359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:28.822359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 288/574] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:28.822359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c4ff-1762-486e-8c93-7b3371804108 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.836949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f655069-a7c8-49c8-91b7-c500a8ccb46b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.872400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4bf3b-4fb6-4db2-82d4-297bcf68fabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.873034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4bf3b-4fb6-4db2-82d4-297bcf68fabd None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.873313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4bf3b-4fb6-4db2-82d4-297bcf68fabd None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.873581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4bf3b-4fb6-4db2-82d4-297bcf68fabd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.874330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4bf3b-4fb6-4db2-82d4-297bcf68fabd None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=20f9b96629544596a8d9b81cce57af21) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:28.874632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4bf3b-4fb6-4db2-82d4-297bcf68fabd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.876063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4bf3b-4fb6-4db2-82d4-297bcf68fabd None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.881469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 287/575] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/role_assignments?user.id=20f9b96629544596a8d9b81cce57af21&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:28.882235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4bf3b-4fb6-4db2-82d4-297bcf68fabd None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.931965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c4ff-1762-486e-8c93-7b3371804108 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.947953 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.971901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1c29-b6cd-423c-8b57-78f3cf2fd1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.972675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1c29-b6cd-423c-8b57-78f3cf2fd1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.972909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1c29-b6cd-423c-8b57-78f3cf2fd1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.973558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1c29-b6cd-423c-8b57-78f3cf2fd1c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.985914 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf1c29-b6cd-423c-8b57-78f3cf2fd1c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.987475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf1c29-b6cd-423c-8b57-78f3cf2fd1c2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-8dcf1c29-b6cd-423c-8b57-78f3cf2fd1c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:29.003538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:29.004555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:29.006192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:29.006192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:29.006192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:29.006192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 289/576] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:29.006192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1c29-b6cd-423c-8b57-78f3cf2fd1c2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.011448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4bf3b-4fb6-4db2-82d4-297bcf68fabd None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.013315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.053355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724931-2ba8-4c03-9b16-250a9cccb5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.053910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724931-2ba8-4c03-9b16-250a9cccb5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.054185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724931-2ba8-4c03-9b16-250a9cccb5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.054688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724931-2ba8-4c03-9b16-250a9cccb5f4 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.060700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc724931-2ba8-4c03-9b16-250a9cccb5f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:29.060700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc724931-2ba8-4c03-9b16-250a9cccb5f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.060700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc724931-2ba8-4c03-9b16-250a9cccb5f4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.076381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 288/577] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:29.078035 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82165a-2fb3-4ed7-8d3d-e0964e99024d None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.078317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82165a-2fb3-4ed7-8d3d-e0964e99024d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.078584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82165a-2fb3-4ed7-8d3d-e0964e99024d None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.079914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 289/578] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:29.080453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82165a-2fb3-4ed7-8d3d-e0964e99024d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.120163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1c29-b6cd-423c-8b57-78f3cf2fd1c2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.154833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcdf5c-4501-4cbe-b954-6e6b2eb3b9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.156000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcdf5c-4501-4cbe-b954-6e6b2eb3b9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.156328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcdf5c-4501-4cbe-b954-6e6b2eb3b9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.156594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcdf5c-4501-4cbe-b954-6e6b2eb3b9c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.157254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcdf5c-4501-4cbe-b954-6e6b2eb3b9c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:29.157549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcdf5c-4501-4cbe-b954-6e6b2eb3b9c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.158898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcdf5c-4501-4cbe-b954-6e6b2eb3b9c2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.172458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 290/579] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:29.177567 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcdf5c-4501-4cbe-b954-6e6b2eb3b9c2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.196652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82165a-2fb3-4ed7-8d3d-e0964e99024d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.208788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.235536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1b0eb-46c2-4443-91a3-4c111beb999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.236133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1b0eb-46c2-4443-91a3-4c111beb999c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.236406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1b0eb-46c2-4443-91a3-4c111beb999c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.236693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1b0eb-46c2-4443-91a3-4c111beb999c None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.237326 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1b0eb-46c2-4443-91a3-4c111beb999c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:29.237620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1b0eb-46c2-4443-91a3-4c111beb999c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.238963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1b0eb-46c2-4443-91a3-4c111beb999c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.255183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 290/580] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:29.255183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1663-cd2c-4468-9721-54bc01255499 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.255183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1663-cd2c-4468-9721-54bc01255499 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.255183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1663-cd2c-4468-9721-54bc01255499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.270668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5dbc1663-cd2c-4468-9721-54bc01255499 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:29.271896 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5dbc1663-cd2c-4468-9721-54bc01255499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:29.287242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.294467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcdf5c-4501-4cbe-b954-6e6b2eb3b9c2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.332840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5832-65ea-476f-96dc-bc0e54ba7425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.333388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5832-65ea-476f-96dc-bc0e54ba7425 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.333683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5832-65ea-476f-96dc-bc0e54ba7425 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.333941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5832-65ea-476f-96dc-bc0e54ba7425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.343239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 291/581] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:29.344077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1663-cd2c-4468-9721-54bc01255499 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.356652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d5832-65ea-476f-96dc-bc0e54ba7425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.356799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d5832-65ea-476f-96dc-bc0e54ba7425 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-440d5832-65ea-476f-96dc-bc0e54ba7425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:29.373558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:29.374601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:29.375474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:29.375474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:29.375474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:29.375474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 291/582] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:29.375474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5832-65ea-476f-96dc-bc0e54ba7425 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.462430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.462625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1663-cd2c-4468-9721-54bc01255499 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.488879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5832-65ea-476f-96dc-bc0e54ba7425 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.498368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374b18a-de3a-4c34-97f3-30ac56b75958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.499056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374b18a-de3a-4c34-97f3-30ac56b75958 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.499414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374b18a-de3a-4c34-97f3-30ac56b75958 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.499581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374b18a-de3a-4c34-97f3-30ac56b75958 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.507059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374b18a-de3a-4c34-97f3-30ac56b75958 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.508687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374b18a-de3a-4c34-97f3-30ac56b75958 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-1374b18a-de3a-4c34-97f3-30ac56b75958 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:29.521215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:29.522140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 292/583] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:29.523058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374b18a-de3a-4c34-97f3-30ac56b75958 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.532371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc71e6-c932-40cb-bdba-20a995fdb74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.533041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc71e6-c932-40cb-bdba-20a995fdb74f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.533304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc71e6-c932-40cb-bdba-20a995fdb74f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.533571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc71e6-c932-40cb-bdba-20a995fdb74f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.537654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.540671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc71e6-c932-40cb-bdba-20a995fdb74f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.542087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc71e6-c932-40cb-bdba-20a995fdb74f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-77dc71e6-c932-40cb-bdba-20a995fdb74f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:29.553331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:29.554203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:29.555094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:29.555094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:29.555094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:29.555094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:29.555094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:29.555094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:29.555094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:29.555094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:29.555094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 292/584] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:29.555608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc71e6-c932-40cb-bdba-20a995fdb74f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.641015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374b18a-de3a-4c34-97f3-30ac56b75958 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.663340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc71e6-c932-40cb-bdba-20a995fdb74f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.679620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea16263-6664-4681-8de3-ff72ae12d207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.680236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea16263-6664-4681-8de3-ff72ae12d207 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.680509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea16263-6664-4681-8de3-ff72ae12d207 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.680814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea16263-6664-4681-8de3-ff72ae12d207 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.692083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea16263-6664-4681-8de3-ff72ae12d207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-4ea16263-6664-4681-8de3-ff72ae12d207 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:29.697087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:29.698001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:29.698829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 293/585] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:29.699830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea16263-6664-4681-8de3-ff72ae12d207 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.705046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11797f46-0c87-4e07-a9f2-b31d99128f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.705662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797f46-0c87-4e07-a9f2-b31d99128f9c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.705943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797f46-0c87-4e07-a9f2-b31d99128f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.706209 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797f46-0c87-4e07-a9f2-b31d99128f9c None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.706846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11797f46-0c87-4e07-a9f2-b31d99128f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:29.707145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11797f46-0c87-4e07-a9f2-b31d99128f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.708494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11797f46-0c87-4e07-a9f2-b31d99128f9c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.716245 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.722578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 293/586] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:29.723223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11797f46-0c87-4e07-a9f2-b31d99128f9c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.780323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.815221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea16263-6664-4681-8de3-ff72ae12d207 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.828146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11797f46-0c87-4e07-a9f2-b31d99128f9c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.851452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9f82d-6287-4d35-b34b-e0f5c4c5f22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.852081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f82d-6287-4d35-b34b-e0f5c4c5f22f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.852346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f82d-6287-4d35-b34b-e0f5c4c5f22f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.852617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f82d-6287-4d35-b34b-e0f5c4c5f22f None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.853353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9f82d-6287-4d35-b34b-e0f5c4c5f22f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:29.853658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9f82d-6287-4d35-b34b-e0f5c4c5f22f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.855089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9f82d-6287-4d35-b34b-e0f5c4c5f22f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.862993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51731-20ea-4e4c-9aef-b5e560ae59bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.863592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51731-20ea-4e4c-9aef-b5e560ae59bc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.863865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51731-20ea-4e4c-9aef-b5e560ae59bc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.864132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51731-20ea-4e4c-9aef-b5e560ae59bc None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.864908 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c51731-20ea-4e4c-9aef-b5e560ae59bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:29.865208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c51731-20ea-4e4c-9aef-b5e560ae59bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.866619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c51731-20ea-4e4c-9aef-b5e560ae59bc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.875381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 294/587] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:29.876468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9f82d-6287-4d35-b34b-e0f5c4c5f22f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.883060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 294/588] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:29.883975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51731-20ea-4e4c-9aef-b5e560ae59bc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.956447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.982185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9f82d-6287-4d35-b34b-e0f5c4c5f22f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.004587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51731-20ea-4e4c-9aef-b5e560ae59bc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.013313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:30.022555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20e675-1fbd-4cc0-8078-cfbf5ca8ab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.023150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20e675-1fbd-4cc0-8078-cfbf5ca8ab77 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.023422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20e675-1fbd-4cc0-8078-cfbf5ca8ab77 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.023684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20e675-1fbd-4cc0-8078-cfbf5ca8ab77 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.024338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20e675-1fbd-4cc0-8078-cfbf5ca8ab77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:30.024653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20e675-1fbd-4cc0-8078-cfbf5ca8ab77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.026027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20e675-1fbd-4cc0-8078-cfbf5ca8ab77 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.035491 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 295/589] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:30.036138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20e675-1fbd-4cc0-8078-cfbf5ca8ab77 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.043624 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd6c0-1e47-41bb-b296-bf48cec72887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.045119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd6c0-1e47-41bb-b296-bf48cec72887 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.045739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd6c0-1e47-41bb-b296-bf48cec72887 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.046301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd6c0-1e47-41bb-b296-bf48cec72887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.056841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dd6c0-1e47-41bb-b296-bf48cec72887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.059066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dd6c0-1e47-41bb-b296-bf48cec72887 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-012dd6c0-1e47-41bb-b296-bf48cec72887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:30.074337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:30.075339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:30.081728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:30.081728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:30.081728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:30.081728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:30.081728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:30.081728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:30.081728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:30.081728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:30.081728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 295/590] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:30.081728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd6c0-1e47-41bb-b296-bf48cec72887 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.150013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20e675-1fbd-4cc0-8078-cfbf5ca8ab77 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.181606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd6c0-1e47-41bb-b296-bf48cec72887 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.186470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3892739-5b3b-4a96-a469-d23c1d8c02e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.187301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3892739-5b3b-4a96-a469-d23c1d8c02e9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.187761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3892739-5b3b-4a96-a469-d23c1d8c02e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.188368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3892739-5b3b-4a96-a469-d23c1d8c02e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.199067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:30.200908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3892739-5b3b-4a96-a469-d23c1d8c02e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.202959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3892739-5b3b-4a96-a469-d23c1d8c02e9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.215717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d4e1-43e6-4c70-a6ba-c3ffe798c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.216302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d4e1-43e6-4c70-a6ba-c3ffe798c39b None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.216577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d4e1-43e6-4c70-a6ba-c3ffe798c39b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.216876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d4e1-43e6-4c70-a6ba-c3ffe798c39b None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/79efccae1afa46e78c25f617bf2dd9dd/roles/5efe6ea0b4354fd3821aaac43d4595d8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-d3892739-5b3b-4a96-a469-d23c1d8c02e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:30.218893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:30.220007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:30.221118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:30.221118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:30.221118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:30.222820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 296/591] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:30.223798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3892739-5b3b-4a96-a469-d23c1d8c02e9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.234940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102d4e1-43e6-4c70-a6ba-c3ffe798c39b None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=79efccae1afa46e78c25f617bf2dd9dd, role_id=5efe6ea0b4354fd3821aaac43d4595d8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.236579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102d4e1-43e6-4c70-a6ba-c3ffe798c39b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.251569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 296/592] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:30 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/79efccae1afa46e78c25f617bf2dd9dd/roles/5efe6ea0b4354fd3821aaac43d4595d8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:30.252687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d4e1-43e6-4c70-a6ba-c3ffe798c39b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.288239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:30.378621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3892739-5b3b-4a96-a469-d23c1d8c02e9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.398751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d4e1-43e6-4c70-a6ba-c3ffe798c39b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.432390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e672d1-eb2a-4d93-9eb8-4c624fa9c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.433050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e672d1-eb2a-4d93-9eb8-4c624fa9c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.433325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e672d1-eb2a-4d93-9eb8-4c624fa9c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.433598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e672d1-eb2a-4d93-9eb8-4c624fa9c5ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.446852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1319f9-7ffe-4b87-89b1-b9811bcd4617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.447213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e672d1-eb2a-4d93-9eb8-4c624fa9c5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.447526 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1319f9-7ffe-4b87-89b1-b9811bcd4617 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.447806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1319f9-7ffe-4b87-89b1-b9811bcd4617 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.448075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1319f9-7ffe-4b87-89b1-b9811bcd4617 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.450081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1319f9-7ffe-4b87-89b1-b9811bcd4617 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:30.450208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e672d1-eb2a-4d93-9eb8-4c624fa9c5ef None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.450287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1319f9-7ffe-4b87-89b1-b9811bcd4617 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.450767 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1319f9-7ffe-4b87-89b1-b9811bcd4617 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.465799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 297/593] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:30.467062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1319f9-7ffe-4b87-89b1-b9811bcd4617 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-e4e672d1-eb2a-4d93-9eb8-4c624fa9c5ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:30.469165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:30.470094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:30.471279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:30.471279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:30.471279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:30.471279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 297/594] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:30.475567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e672d1-eb2a-4d93-9eb8-4c624fa9c5ef None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.505977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:30.591562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1319f9-7ffe-4b87-89b1-b9811bcd4617 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.600096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:30.610692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e672d1-eb2a-4d93-9eb8-4c624fa9c5ef None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.634852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8329e-76f2-4bcb-bc27-66c17c6071f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.635596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8329e-76f2-4bcb-bc27-66c17c6071f9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.635970 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8329e-76f2-4bcb-bc27-66c17c6071f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.636339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8329e-76f2-4bcb-bc27-66c17c6071f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.637154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8329e-76f2-4bcb-bc27-66c17c6071f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:30.637967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8329e-76f2-4bcb-bc27-66c17c6071f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.640368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8329e-76f2-4bcb-bc27-66c17c6071f9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.656162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 298/595] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:30.658643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8329e-76f2-4bcb-bc27-66c17c6071f9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.661306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4191b-b3c0-4cfa-bae6-9df16e1ade74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.661919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4191b-b3c0-4cfa-bae6-9df16e1ade74 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.662198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4191b-b3c0-4cfa-bae6-9df16e1ade74 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.662467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4191b-b3c0-4cfa-bae6-9df16e1ade74 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.663111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4191b-b3c0-4cfa-bae6-9df16e1ade74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:30.663413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4191b-b3c0-4cfa-bae6-9df16e1ade74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.664804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4191b-b3c0-4cfa-bae6-9df16e1ade74 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.682288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 298/596] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:30.683167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4191b-b3c0-4cfa-bae6-9df16e1ade74 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.774164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:30.789713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8329e-76f2-4bcb-bc27-66c17c6071f9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.815196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4191b-b3c0-4cfa-bae6-9df16e1ade74 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.830117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98310cc-293c-40f6-8fc7-1e1de4641f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.831145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98310cc-293c-40f6-8fc7-1e1de4641f11 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.831626 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98310cc-293c-40f6-8fc7-1e1de4641f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.832090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98310cc-293c-40f6-8fc7-1e1de4641f11 None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/98925192a33544e081f1a02faed60b7f/roles/5efe6ea0b4354fd3821aaac43d4595d8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.847821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98310cc-293c-40f6-8fc7-1e1de4641f11 None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=98925192a33544e081f1a02faed60b7f, role_id=5efe6ea0b4354fd3821aaac43d4595d8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.849610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98310cc-293c-40f6-8fc7-1e1de4641f11 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.863223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414ccea-a17d-4a44-bbba-63f338c9b5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.863853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414ccea-a17d-4a44-bbba-63f338c9b5dc None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.864119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414ccea-a17d-4a44-bbba-63f338c9b5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.864385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414ccea-a17d-4a44-bbba-63f338c9b5dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.868124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 299/597] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:30 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/98925192a33544e081f1a02faed60b7f/roles/5efe6ea0b4354fd3821aaac43d4595d8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:30.869358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98310cc-293c-40f6-8fc7-1e1de4641f11 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.871918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414ccea-a17d-4a44-bbba-63f338c9b5dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.873469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414ccea-a17d-4a44-bbba-63f338c9b5dc None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-f414ccea-a17d-4a44-bbba-63f338c9b5dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:30.886440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:30.887465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:30.889037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:30.889037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:30.889037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:30.889037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:30.889037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:30.889037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:30.889037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:30.889037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:30.889037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 299/598] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:30.894156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414ccea-a17d-4a44-bbba-63f338c9b5dc None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.911940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.021987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98310cc-293c-40f6-8fc7-1e1de4641f11 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.034916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414ccea-a17d-4a44-bbba-63f338c9b5dc None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.063900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cba2e-c222-46b8-85d3-d9825902776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.064466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cba2e-c222-46b8-85d3-d9825902776b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.064985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cba2e-c222-46b8-85d3-d9825902776b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.065213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cba2e-c222-46b8-85d3-d9825902776b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.073506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cba2e-c222-46b8-85d3-d9825902776b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.075054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cba2e-c222-46b8-85d3-d9825902776b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.076142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965056f7-9506-4f82-9e91-d088e51bc714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.077609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965056f7-9506-4f82-9e91-d088e51bc714 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.077609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965056f7-9506-4f82-9e91-d088e51bc714 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.077609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965056f7-9506-4f82-9e91-d088e51bc714 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.078186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.078763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965056f7-9506-4f82-9e91-d088e51bc714 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:31.079063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965056f7-9506-4f82-9e91-d088e51bc714 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.082723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965056f7-9506-4f82-9e91-d088e51bc714 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-1f8cba2e-c222-46b8-85d3-d9825902776b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:31.089172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:31.090128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:31.091062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:31.091062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:31.091062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:31.091062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:31.091062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:31.091062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:31.091062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:31.091062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:31.091062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:09:31.091062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:31.093831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 300/599] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:31.095225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6959d-d533-48b9-af7a-d35a04a431c5 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.095792 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6959d-d533-48b9-af7a-d35a04a431c5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.096200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6959d-d533-48b9-af7a-d35a04a431c5 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.097978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 301/601] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:31.099414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 300/601] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:31.102816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6959d-d533-48b9-af7a-d35a04a431c5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.103060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965056f7-9506-4f82-9e91-d088e51bc714 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.194949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.211029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6959d-d533-48b9-af7a-d35a04a431c5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.223170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965056f7-9506-4f82-9e91-d088e51bc714 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.247033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661519d-a0fd-490b-81c9-d457029057aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.247817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661519d-a0fd-490b-81c9-d457029057aa None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.248094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661519d-a0fd-490b-81c9-d457029057aa None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.248506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661519d-a0fd-490b-81c9-d457029057aa None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/f0b215bfb43742678bd5a728973dbc46/roles/5efe6ea0b4354fd3821aaac43d4595d8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.260354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cbf6-a4d8-4565-9e3a-5d8be0806700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.261206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cbf6-a4d8-4565-9e3a-5d8be0806700 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.261668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cbf6-a4d8-4565-9e3a-5d8be0806700 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.262008 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cbf6-a4d8-4565-9e3a-5d8be0806700 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.262846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571cbf6-a4d8-4565-9e3a-5d8be0806700 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:31.263216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571cbf6-a4d8-4565-9e3a-5d8be0806700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.264406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661519d-a0fd-490b-81c9-d457029057aa None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=f0b215bfb43742678bd5a728973dbc46, role_id=5efe6ea0b4354fd3821aaac43d4595d8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.264930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571cbf6-a4d8-4565-9e3a-5d8be0806700 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.265900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661519d-a0fd-490b-81c9-d457029057aa None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.284401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 302/602] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:31 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/f0b215bfb43742678bd5a728973dbc46/roles/5efe6ea0b4354fd3821aaac43d4595d8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:31.285801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb6bbe-4430-4aec-a48a-4c049bf5149b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.286028 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb6bbe-4430-4aec-a48a-4c049bf5149b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.286383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb6bbe-4430-4aec-a48a-4c049bf5149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.297470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 301/603] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Aug 9 12:09:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:31.303439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cbf6-a4d8-4565-9e3a-5d8be0806700 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.323797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d4fb6bbe-4430-4aec-a48a-4c049bf5149b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:31.326517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d4fb6bbe-4430-4aec-a48a-4c049bf5149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:31.421517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.476007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 303/604] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:31.516278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cbf6-a4d8-4565-9e3a-5d8be0806700 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.518397 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb6bbe-4430-4aec-a48a-4c049bf5149b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.549244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.558606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035471e-9400-4504-a950-6977acb21530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.558606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035471e-9400-4504-a950-6977acb21530 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.558606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035471e-9400-4504-a950-6977acb21530 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.558606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035471e-9400-4504-a950-6977acb21530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.570088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035471e-9400-4504-a950-6977acb21530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.571400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035471e-9400-4504-a950-6977acb21530 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-f035471e-9400-4504-a950-6977acb21530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:31.586834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:31.587780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:31.588716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:31.588716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:31.588716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:31.588716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 302/605] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:31.594305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035471e-9400-4504-a950-6977acb21530 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.664998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb6bbe-4430-4aec-a48a-4c049bf5149b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.699220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035471e-9400-4504-a950-6977acb21530 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.736553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302b85b-5fb7-4ac0-9597-5b1b126f86ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.737212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302b85b-5fb7-4ac0-9597-5b1b126f86ef None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.737483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302b85b-5fb7-4ac0-9597-5b1b126f86ef None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.737746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302b85b-5fb7-4ac0-9597-5b1b126f86ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.743429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf792f1-bcbe-41d1-9914-0ce3e33d3d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.744027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf792f1-bcbe-41d1-9914-0ce3e33d3d67 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.744297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf792f1-bcbe-41d1-9914-0ce3e33d3d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.744559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf792f1-bcbe-41d1-9914-0ce3e33d3d67 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.745218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf792f1-bcbe-41d1-9914-0ce3e33d3d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:31.745510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf792f1-bcbe-41d1-9914-0ce3e33d3d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.746866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf792f1-bcbe-41d1-9914-0ce3e33d3d67 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.761772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302b85b-5fb7-4ac0-9597-5b1b126f86ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d302b85b-5fb7-4ac0-9597-5b1b126f86ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:31.767000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:31.767911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:31.768780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 304/606] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:31.777923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 303/607] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:31.780671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302b85b-5fb7-4ac0-9597-5b1b126f86ef None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.783566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf792f1-bcbe-41d1-9914-0ce3e33d3d67 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.849122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.870851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.946712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302b85b-5fb7-4ac0-9597-5b1b126f86ef None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.978353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf792f1-bcbe-41d1-9914-0ce3e33d3d67 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.005763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0208d17-b46b-4d31-a91e-8120107e0801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.006367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0208d17-b46b-4d31-a91e-8120107e0801 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.006636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0208d17-b46b-4d31-a91e-8120107e0801 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.006896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0208d17-b46b-4d31-a91e-8120107e0801 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.007553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0208d17-b46b-4d31-a91e-8120107e0801 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:32.007846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0208d17-b46b-4d31-a91e-8120107e0801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.009235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0208d17-b46b-4d31-a91e-8120107e0801 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.027055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 305/608] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:32.032565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0208d17-b46b-4d31-a91e-8120107e0801 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.047780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860be64-87bc-4186-ab00-6eb0bf913329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.048693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860be64-87bc-4186-ab00-6eb0bf913329 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.048969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860be64-87bc-4186-ab00-6eb0bf913329 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.049519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860be64-87bc-4186-ab00-6eb0bf913329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.060355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860be64-87bc-4186-ab00-6eb0bf913329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.064185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860be64-87bc-4186-ab00-6eb0bf913329 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-6860be64-87bc-4186-ab00-6eb0bf913329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:32.086531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:32.087566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:32.088449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:32.088449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:32.088449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:32.088449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:32.088449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:32.088449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:32.088449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:32.088449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:32.088449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 304/609] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:32.093986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860be64-87bc-4186-ab00-6eb0bf913329 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.219414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:32.227234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0208d17-b46b-4d31-a91e-8120107e0801 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.269389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3548877-6f38-4fa6-b3b4-6fb4fee70fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.270598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3548877-6f38-4fa6-b3b4-6fb4fee70fcd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.271040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3548877-6f38-4fa6-b3b4-6fb4fee70fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.271543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3548877-6f38-4fa6-b3b4-6fb4fee70fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.283893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3548877-6f38-4fa6-b3b4-6fb4fee70fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.285880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3548877-6f38-4fa6-b3b4-6fb4fee70fcd None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e3548877-6f38-4fa6-b3b4-6fb4fee70fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:32.302674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:32.303838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:32.304979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:32.304979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:32.304979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:32.306850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 306/610] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:32.314292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3548877-6f38-4fa6-b3b4-6fb4fee70fcd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.320299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860be64-87bc-4186-ab00-6eb0bf913329 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.324298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:32.367139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d1f44-e909-4447-b8b3-3b513757a0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.368044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d1f44-e909-4447-b8b3-3b513757a0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.369614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d1f44-e909-4447-b8b3-3b513757a0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.370060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d1f44-e909-4447-b8b3-3b513757a0f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.370938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d1f44-e909-4447-b8b3-3b513757a0f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:32.372707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d1f44-e909-4447-b8b3-3b513757a0f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.378078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d1f44-e909-4447-b8b3-3b513757a0f7 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.407304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 305/611] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:32.408564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a11a2-61a0-47cd-8297-977bc13e36e9 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.408883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a11a2-61a0-47cd-8297-977bc13e36e9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.409152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a11a2-61a0-47cd-8297-977bc13e36e9 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.414310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 306/612] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:32.417378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a11a2-61a0-47cd-8297-977bc13e36e9 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.490408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3548877-6f38-4fa6-b3b4-6fb4fee70fcd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.526423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4040d-8542-426a-8fd5-3396bcaa2ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.527022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4040d-8542-426a-8fd5-3396bcaa2ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.527297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4040d-8542-426a-8fd5-3396bcaa2ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.527570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4040d-8542-426a-8fd5-3396bcaa2ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.528202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4040d-8542-426a-8fd5-3396bcaa2ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:32.528520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4040d-8542-426a-8fd5-3396bcaa2ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.528921 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a11a2-61a0-47cd-8297-977bc13e36e9 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.529946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4040d-8542-426a-8fd5-3396bcaa2ce4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.543454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 307/613] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:32.544961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6936cb-a3d8-4f1f-b859-2d400b513374 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.545147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6936cb-a3d8-4f1f-b859-2d400b513374 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.545943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6936cb-a3d8-4f1f-b859-2d400b513374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.566041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ee6936cb-a3d8-4f1f-b859-2d400b513374 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:32.567327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ee6936cb-a3d8-4f1f-b859-2d400b513374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:32.575702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:32.577779 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97dbc2-7a15-4246-8fe2-ed4ad7ee6edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.579708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97dbc2-7a15-4246-8fe2-ed4ad7ee6edc None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.580612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97dbc2-7a15-4246-8fe2-ed4ad7ee6edc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.581098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97dbc2-7a15-4246-8fe2-ed4ad7ee6edc None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/13063cbf860c4ca98666500c3c125933/roles/5efe6ea0b4354fd3821aaac43d4595d8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.601247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97dbc2-7a15-4246-8fe2-ed4ad7ee6edc None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=13063cbf860c4ca98666500c3c125933, role_id=5efe6ea0b4354fd3821aaac43d4595d8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.603174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97dbc2-7a15-4246-8fe2-ed4ad7ee6edc None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.620720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 307/614] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:32 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/13063cbf860c4ca98666500c3c125933/roles/5efe6ea0b4354fd3821aaac43d4595d8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:32.622472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97dbc2-7a15-4246-8fe2-ed4ad7ee6edc None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.648113 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:32.653708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 308/615] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:32.679302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6936cb-a3d8-4f1f-b859-2d400b513374 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.793253 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6936cb-a3d8-4f1f-b859-2d400b513374 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.810251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97dbc2-7a15-4246-8fe2-ed4ad7ee6edc None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.837653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606079e-5c10-4a24-9a6e-62e113309e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.838680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606079e-5c10-4a24-9a6e-62e113309e54 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.839323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606079e-5c10-4a24-9a6e-62e113309e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.839884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606079e-5c10-4a24-9a6e-62e113309e54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.852107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606079e-5c10-4a24-9a6e-62e113309e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:32.852633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec550c-e781-4e5e-a04e-d0acca762fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.853274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec550c-e781-4e5e-a04e-d0acca762fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.853548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec550c-e781-4e5e-a04e-d0acca762fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.853801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec550c-e781-4e5e-a04e-d0acca762fd8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a606079e-5c10-4a24-9a6e-62e113309e54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:32.858498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:32.859432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:32.860298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:32.862689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec550c-e781-4e5e-a04e-d0acca762fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.863144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 309/616] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:32.867917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec550c-e781-4e5e-a04e-d0acca762fd8 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.869134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606079e-5c10-4a24-9a6e-62e113309e54 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-e0ec550c-e781-4e5e-a04e-d0acca762fd8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:32.876558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:32.877515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:32.878485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 308/617] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:32.882285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:32.890206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec550c-e781-4e5e-a04e-d0acca762fd8 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.982196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606079e-5c10-4a24-9a6e-62e113309e54 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.019237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e2eb5-edcc-4bfa-a296-08cdb954b623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.020299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e2eb5-edcc-4bfa-a296-08cdb954b623 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.020859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e2eb5-edcc-4bfa-a296-08cdb954b623 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.021368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e2eb5-edcc-4bfa-a296-08cdb954b623 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.022223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e2eb5-edcc-4bfa-a296-08cdb954b623 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:33.022722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e2eb5-edcc-4bfa-a296-08cdb954b623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.024284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e2eb5-edcc-4bfa-a296-08cdb954b623 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.033592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 310/618] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:33.039259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e2eb5-edcc-4bfa-a296-08cdb954b623 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.044345 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.099606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec550c-e781-4e5e-a04e-d0acca762fd8 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.108817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.141985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b014d72-e4d0-4089-94a1-4fbaa05e5a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.142946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b014d72-e4d0-4089-94a1-4fbaa05e5a0a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.143382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b014d72-e4d0-4089-94a1-4fbaa05e5a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.143803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b014d72-e4d0-4089-94a1-4fbaa05e5a0a None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.144805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b014d72-e4d0-4089-94a1-4fbaa05e5a0a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:33.145352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b014d72-e4d0-4089-94a1-4fbaa05e5a0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.146952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b014d72-e4d0-4089-94a1-4fbaa05e5a0a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.151463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e2eb5-edcc-4bfa-a296-08cdb954b623 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.173644 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 309/619] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:33.179552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b014d72-e4d0-4089-94a1-4fbaa05e5a0a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.221497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6fec4-c84d-4d92-82c6-217be22c3c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.222416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fec4-c84d-4d92-82c6-217be22c3c5c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.222855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fec4-c84d-4d92-82c6-217be22c3c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.223277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fec4-c84d-4d92-82c6-217be22c3c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.239454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6fec4-c84d-4d92-82c6-217be22c3c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.241171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6fec4-c84d-4d92-82c6-217be22c3c5c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f5e6fec4-c84d-4d92-82c6-217be22c3c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:33.256095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:33.257435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:33.258537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:33.258537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:33.258537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:33.260410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 311/620] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:33.266456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6fec4-c84d-4d92-82c6-217be22c3c5c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.346434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b014d72-e4d0-4089-94a1-4fbaa05e5a0a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.379841 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.385519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe38e89-bf04-4e46-9a0f-654a6e502acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.386249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe38e89-bf04-4e46-9a0f-654a6e502acc None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.386526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe38e89-bf04-4e46-9a0f-654a6e502acc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.386784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe38e89-bf04-4e46-9a0f-654a6e502acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.399180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6fec4-c84d-4d92-82c6-217be22c3c5c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.403749 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe38e89-bf04-4e46-9a0f-654a6e502acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.405891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe38e89-bf04-4e46-9a0f-654a6e502acc None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.421617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-6fe38e89-bf04-4e46-9a0f-654a6e502acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:33.430049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:33.431179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:33.432485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:33.432485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:33.432485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:33.432485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 310/621] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:33.432788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60375-9990-45f4-8d96-43d726fe09dd None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.435327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60375-9990-45f4-8d96-43d726fe09dd None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.435327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60375-9990-45f4-8d96-43d726fe09dd None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.436741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 311/622] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:33.437605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e60375-9990-45f4-8d96-43d726fe09dd None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.444381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57c788-9942-44c9-bf11-81645fbf9261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.445126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57c788-9942-44c9-bf11-81645fbf9261 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.445499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57c788-9942-44c9-bf11-81645fbf9261 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.446593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57c788-9942-44c9-bf11-81645fbf9261 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.446593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57c788-9942-44c9-bf11-81645fbf9261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:33.447054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57c788-9942-44c9-bf11-81645fbf9261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.448522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57c788-9942-44c9-bf11-81645fbf9261 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.461950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 312/623] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:33.467881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99408b84-ae1e-4b82-a7a9-6fc0a64cbdd1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.468275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99408b84-ae1e-4b82-a7a9-6fc0a64cbdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.468659 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99408b84-ae1e-4b82-a7a9-6fc0a64cbdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.487870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-99408b84-ae1e-4b82-a7a9-6fc0a64cbdd1 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:33.489230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-99408b84-ae1e-4b82-a7a9-6fc0a64cbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:33.555645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e60375-9990-45f4-8d96-43d726fe09dd None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.564698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 313/624] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:33.564698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99408b84-ae1e-4b82-a7a9-6fc0a64cbdd1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.616309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad494751-1d26-4fb9-afbf-6ef2d4a6269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.616890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad494751-1d26-4fb9-afbf-6ef2d4a6269c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.617164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad494751-1d26-4fb9-afbf-6ef2d4a6269c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.617428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad494751-1d26-4fb9-afbf-6ef2d4a6269c None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.618059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad494751-1d26-4fb9-afbf-6ef2d4a6269c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:33.618356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad494751-1d26-4fb9-afbf-6ef2d4a6269c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.619859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad494751-1d26-4fb9-afbf-6ef2d4a6269c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.633602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 312/625] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:33.634428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad494751-1d26-4fb9-afbf-6ef2d4a6269c None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.674791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99408b84-ae1e-4b82-a7a9-6fc0a64cbdd1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.682312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.684328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.715414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0601e8-0dcf-4ad6-9f56-7aef4f4bb1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.716139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0601e8-0dcf-4ad6-9f56-7aef4f4bb1ca None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.716486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0601e8-0dcf-4ad6-9f56-7aef4f4bb1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.717766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0601e8-0dcf-4ad6-9f56-7aef4f4bb1ca None admin] PATH_INFO: `/v3/users/glance` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.725368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0601e8-0dcf-4ad6-9f56-7aef4f4bb1ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.726966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0601e8-0dcf-4ad6-9f56-7aef4f4bb1ca None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-eb0601e8-0dcf-4ad6-9f56-7aef4f4bb1ca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:33.740849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:33.741814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:33.742754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:33.742754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:33.742754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:33.742754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:33.742754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:33.742754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:33.742754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:33.742754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:33.742754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:33.742754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:33.746681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 314/626] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:33.747572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0601e8-0dcf-4ad6-9f56-7aef4f4bb1ca None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.748222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad494751-1d26-4fb9-afbf-6ef2d4a6269c None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.785918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16a0d7-01e4-4dc1-ad5d-27136e2de694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.786836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16a0d7-01e4-4dc1-ad5d-27136e2de694 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.787286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16a0d7-01e4-4dc1-ad5d-27136e2de694 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.787825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16a0d7-01e4-4dc1-ad5d-27136e2de694 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.799889 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16a0d7-01e4-4dc1-ad5d-27136e2de694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-8e16a0d7-01e4-4dc1-ad5d-27136e2de694 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:33.804919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:33.805829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:33.806639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:33.808550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 313/627] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:33.809650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16a0d7-01e4-4dc1-ad5d-27136e2de694 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.856725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0601e8-0dcf-4ad6-9f56-7aef4f4bb1ca None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.891132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd13ff-6e58-4e89-ad69-9b64f1947512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.891684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd13ff-6e58-4e89-ad69-9b64f1947512 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.891985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd13ff-6e58-4e89-ad69-9b64f1947512 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.892239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd13ff-6e58-4e89-ad69-9b64f1947512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.900134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd13ff-6e58-4e89-ad69-9b64f1947512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.901621 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd13ff-6e58-4e89-ad69-9b64f1947512 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-27bd13ff-6e58-4e89-ad69-9b64f1947512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:33.913646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:33.914527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:33.915387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:33.915387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:33.915387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:33.915387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:33.915387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:33.915387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:33.915387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:33.915387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:33.919398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 315/628] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:33.921224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c84aa9-c2e7-4019-829b-66365e5f6ed2 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.921803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c84aa9-c2e7-4019-829b-66365e5f6ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.922021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c84aa9-c2e7-4019-829b-66365e5f6ed2 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.923334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 316/629] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:33.924270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c84aa9-c2e7-4019-829b-66365e5f6ed2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.924583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16a0d7-01e4-4dc1-ad5d-27136e2de694 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.930440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.956558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.966810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34f0c-890c-4f48-b8b0-225201682d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.967966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34f0c-890c-4f48-b8b0-225201682d91 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.968247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34f0c-890c-4f48-b8b0-225201682d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.968528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34f0c-890c-4f48-b8b0-225201682d91 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.969314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee34f0c-890c-4f48-b8b0-225201682d91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:33.969610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee34f0c-890c-4f48-b8b0-225201682d91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.971076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee34f0c-890c-4f48-b8b0-225201682d91 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.991638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 314/630] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:33.992613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34f0c-890c-4f48-b8b0-225201682d91 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.047523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c84aa9-c2e7-4019-829b-66365e5f6ed2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.084947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d76dd-2cd5-48a1-a54a-1ea7c14f38dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.085565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d76dd-2cd5-48a1-a54a-1ea7c14f38dc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.085841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d76dd-2cd5-48a1-a54a-1ea7c14f38dc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.086135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d76dd-2cd5-48a1-a54a-1ea7c14f38dc None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.086796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d76dd-2cd5-48a1-a54a-1ea7c14f38dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:34.087096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d76dd-2cd5-48a1-a54a-1ea7c14f38dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.088463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d76dd-2cd5-48a1-a54a-1ea7c14f38dc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.101746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 317/631] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:34.102415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34f0c-890c-4f48-b8b0-225201682d91 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.103377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e7b7b-7ac5-4975-bd5a-0a4ec62050de None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.103808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e7b7b-7ac5-4975-bd5a-0a4ec62050de None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.104223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e7b7b-7ac5-4975-bd5a-0a4ec62050de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.122759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-385e7b7b-7ac5-4975-bd5a-0a4ec62050de None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:34.124551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-385e7b7b-7ac5-4975-bd5a-0a4ec62050de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:34.140229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfdf6d-2397-4821-9460-d09d8aadd8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.141039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfdf6d-2397-4821-9460-d09d8aadd8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.141411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfdf6d-2397-4821-9460-d09d8aadd8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.141737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfdf6d-2397-4821-9460-d09d8aadd8f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.142520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfdf6d-2397-4821-9460-d09d8aadd8f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:34.143163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfdf6d-2397-4821-9460-d09d8aadd8f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.144469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfdf6d-2397-4821-9460-d09d8aadd8f9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.156977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 315/632] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:34.157929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfdf6d-2397-4821-9460-d09d8aadd8f9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.188093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.199919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 318/633] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:34.204655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e7b7b-7ac5-4975-bd5a-0a4ec62050de None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.220973 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.281356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfdf6d-2397-4821-9460-d09d8aadd8f9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.310642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e7b7b-7ac5-4975-bd5a-0a4ec62050de None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.322145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3449e-41b2-4a44-a3e6-076aeea5b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.323139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3449e-41b2-4a44-a3e6-076aeea5b04a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.323509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3449e-41b2-4a44-a3e6-076aeea5b04a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.323871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3449e-41b2-4a44-a3e6-076aeea5b04a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.345970 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c91fb-2aa3-4e64-b657-1971376f7b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.346605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c91fb-2aa3-4e64-b657-1971376f7b1b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.346879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c91fb-2aa3-4e64-b657-1971376f7b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.347144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c91fb-2aa3-4e64-b657-1971376f7b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.357738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c91fb-2aa3-4e64-b657-1971376f7b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.359380 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c91fb-2aa3-4e64-b657-1971376f7b1b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e70c91fb-2aa3-4e64-b657-1971376f7b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:34.373376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:34.375527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:34.376463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:34.376463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:34.376463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:34.379645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 319/634] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:34.380405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c91fb-2aa3-4e64-b657-1971376f7b1b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.408172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3449e-41b2-4a44-a3e6-076aeea5b04a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.409711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3449e-41b2-4a44-a3e6-076aeea5b04a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.437714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.463190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.496267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c91fb-2aa3-4e64-b657-1971376f7b1b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.523999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 316/635] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:34.529481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3449e-41b2-4a44-a3e6-076aeea5b04a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.532072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a0284-48fc-4fa6-bfd1-d177ed08ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.533622 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a0284-48fc-4fa6-bfd1-d177ed08ea91 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.533622 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a0284-48fc-4fa6-bfd1-d177ed08ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.533622 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a0284-48fc-4fa6-bfd1-d177ed08ea91 None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/20f9b96629544596a8d9b81cce57af21/roles/5efe6ea0b4354fd3821aaac43d4595d8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.549244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a0284-48fc-4fa6-bfd1-d177ed08ea91 None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=20f9b96629544596a8d9b81cce57af21, role_id=5efe6ea0b4354fd3821aaac43d4595d8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.550673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a0284-48fc-4fa6-bfd1-d177ed08ea91 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.572484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 320/636] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:34 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/20f9b96629544596a8d9b81cce57af21/roles/5efe6ea0b4354fd3821aaac43d4595d8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:34.572484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a0284-48fc-4fa6-bfd1-d177ed08ea91 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.655160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3449e-41b2-4a44-a3e6-076aeea5b04a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.694907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a0284-48fc-4fa6-bfd1-d177ed08ea91 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.695991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.705373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88433d4-f93a-4319-91ae-4391d263cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.706024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88433d4-f93a-4319-91ae-4391d263cd99 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.706310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88433d4-f93a-4319-91ae-4391d263cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.706585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88433d4-f93a-4319-91ae-4391d263cd99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.722198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.725112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88433d4-f93a-4319-91ae-4391d263cd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-e88433d4-f93a-4319-91ae-4391d263cd99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:34.736656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:34.737704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:34.738675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:34.740537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 317/637] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:34.741495 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88433d4-f93a-4319-91ae-4391d263cd99 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.749461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153fe3e-3710-4458-a16d-4fb6b76b4fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.750302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153fe3e-3710-4458-a16d-4fb6b76b4fbd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.750681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153fe3e-3710-4458-a16d-4fb6b76b4fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.751046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153fe3e-3710-4458-a16d-4fb6b76b4fbd None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.751808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153fe3e-3710-4458-a16d-4fb6b76b4fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:34.752213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153fe3e-3710-4458-a16d-4fb6b76b4fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.753754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153fe3e-3710-4458-a16d-4fb6b76b4fbd None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.767342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 321/638] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:34.768302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153fe3e-3710-4458-a16d-4fb6b76b4fbd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.875335 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88433d4-f93a-4319-91ae-4391d263cd99 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.896176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153fe3e-3710-4458-a16d-4fb6b76b4fbd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.913088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf68d1-6820-4f7c-9561-8ce4a32e7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.913780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf68d1-6820-4f7c-9561-8ce4a32e7b96 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.914058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf68d1-6820-4f7c-9561-8ce4a32e7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.914327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf68d1-6820-4f7c-9561-8ce4a32e7b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.927275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf68d1-6820-4f7c-9561-8ce4a32e7b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.929323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf68d1-6820-4f7c-9561-8ce4a32e7b96 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.933460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecd6ca-0d0e-4362-a9dd-793afbd39171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.934063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecd6ca-0d0e-4362-a9dd-793afbd39171 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.934340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecd6ca-0d0e-4362-a9dd-793afbd39171 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.934611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecd6ca-0d0e-4362-a9dd-793afbd39171 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.935261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecd6ca-0d0e-4362-a9dd-793afbd39171 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:34.935562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecd6ca-0d0e-4362-a9dd-793afbd39171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.937519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecd6ca-0d0e-4362-a9dd-793afbd39171 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-95bf68d1-6820-4f7c-9561-8ce4a32e7b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:34.945625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:34.951687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:34.952936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:34.952936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:34.952936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:34.953109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 322/639] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:34.953109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecd6ca-0d0e-4362-a9dd-793afbd39171 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.953248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 318/640] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:34.953248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9875af-3264-4619-938e-567c3df11bb4 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.953248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9875af-3264-4619-938e-567c3df11bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.953248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9875af-3264-4619-938e-567c3df11bb4 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.954723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 319/641] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:34.955358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9875af-3264-4619-938e-567c3df11bb4 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.993257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.004965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.065562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9875af-3264-4619-938e-567c3df11bb4 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.067774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecd6ca-0d0e-4362-a9dd-793afbd39171 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.104719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd796dd-b8ed-4dff-8c2c-99cf9ccbca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.105353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd796dd-b8ed-4dff-8c2c-99cf9ccbca2a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.105635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd796dd-b8ed-4dff-8c2c-99cf9ccbca2a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.105903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd796dd-b8ed-4dff-8c2c-99cf9ccbca2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.107344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcd908-8a1b-461a-a753-84f12618c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.108402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcd908-8a1b-461a-a753-84f12618c4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.108901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcd908-8a1b-461a-a753-84f12618c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.109265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcd908-8a1b-461a-a753-84f12618c4e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.109901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcd908-8a1b-461a-a753-84f12618c4e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:35.110196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcd908-8a1b-461a-a753-84f12618c4e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.111603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcd908-8a1b-461a-a753-84f12618c4e6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.114578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd796dd-b8ed-4dff-8c2c-99cf9ccbca2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.115982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd796dd-b8ed-4dff-8c2c-99cf9ccbca2a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.124750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 320/642] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:35.125537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcd908-8a1b-461a-a753-84f12618c4e6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-2cd796dd-b8ed-4dff-8c2c-99cf9ccbca2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:35.132543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:35.133586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:35.134514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:35.134514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:35.134514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:35.134514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:35.134514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:35.134514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:35.134514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:35.134514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:35.134514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:35.134514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:35.138370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 323/643] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:35.139899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b18685-71be-4eec-a5cf-5bf2e07e2753 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.140451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b18685-71be-4eec-a5cf-5bf2e07e2753 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.140451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b18685-71be-4eec-a5cf-5bf2e07e2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.160378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-21b18685-71be-4eec-a5cf-5bf2e07e2753 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:35.161589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-21b18685-71be-4eec-a5cf-5bf2e07e2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:35.224862 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.232414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcd908-8a1b-461a-a753-84f12618c4e6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.236744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 324/644] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:35.236744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b18685-71be-4eec-a5cf-5bf2e07e2753 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.288729 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fcdd5-9f4f-4178-bbe4-1531ea9729bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.289705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fcdd5-9f4f-4178-bbe4-1531ea9729bf None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.290200 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fcdd5-9f4f-4178-bbe4-1531ea9729bf None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.290567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fcdd5-9f4f-4178-bbe4-1531ea9729bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.292065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.306910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fcdd5-9f4f-4178-bbe4-1531ea9729bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.309354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fcdd5-9f4f-4178-bbe4-1531ea9729bf None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-4f8fcdd5-9f4f-4178-bbe4-1531ea9729bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:35.333687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:35.335489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:35.337512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:35.337512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:35.337512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:35.337512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 321/645] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:35.337512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fcdd5-9f4f-4178-bbe4-1531ea9729bf None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.406272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b18685-71be-4eec-a5cf-5bf2e07e2753 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.450399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433dae7-7308-4300-9dbf-38fec5d1c6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.452731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433dae7-7308-4300-9dbf-38fec5d1c6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.453014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433dae7-7308-4300-9dbf-38fec5d1c6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.453281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433dae7-7308-4300-9dbf-38fec5d1c6b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.461152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433dae7-7308-4300-9dbf-38fec5d1c6b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.462646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433dae7-7308-4300-9dbf-38fec5d1c6b4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f433dae7-7308-4300-9dbf-38fec5d1c6b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:35.473682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:35.474719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:35.475643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:35.475643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:35.475643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:35.475643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:35.475643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:35.475643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:35.475643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:35.475643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:35.475643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 325/646] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:35.475643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433dae7-7308-4300-9dbf-38fec5d1c6b4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.488692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fcdd5-9f4f-4178-bbe4-1531ea9729bf None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.525138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e068804-46f5-40ab-8dd7-4ce40c4236f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.525740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e068804-46f5-40ab-8dd7-4ce40c4236f9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.526029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e068804-46f5-40ab-8dd7-4ce40c4236f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.526280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e068804-46f5-40ab-8dd7-4ce40c4236f9 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.526987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e068804-46f5-40ab-8dd7-4ce40c4236f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:35.527292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e068804-46f5-40ab-8dd7-4ce40c4236f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.528742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e068804-46f5-40ab-8dd7-4ce40c4236f9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.552478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 322/647] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:35.552478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e068804-46f5-40ab-8dd7-4ce40c4236f9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.555615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.576915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.587421 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433dae7-7308-4300-9dbf-38fec5d1c6b4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.623377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8406e1-f49d-4d84-bb05-961ae8940fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.624770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8406e1-f49d-4d84-bb05-961ae8940fdd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.625042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8406e1-f49d-4d84-bb05-961ae8940fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.625305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8406e1-f49d-4d84-bb05-961ae8940fdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.636597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8406e1-f49d-4d84-bb05-961ae8940fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-aa8406e1-f49d-4d84-bb05-961ae8940fdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:35.641569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:35.642677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:35.643759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:35.647543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 326/648] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:35.648133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8406e1-f49d-4d84-bb05-961ae8940fdd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.662247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e068804-46f5-40ab-8dd7-4ce40c4236f9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.704500 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649953a3-47c8-4b28-b83c-0bcf1cd4d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.705290 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649953a3-47c8-4b28-b83c-0bcf1cd4d37b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.705651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649953a3-47c8-4b28-b83c-0bcf1cd4d37b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.706022 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649953a3-47c8-4b28-b83c-0bcf1cd4d37b None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.706758 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649953a3-47c8-4b28-b83c-0bcf1cd4d37b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:35.707154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649953a3-47c8-4b28-b83c-0bcf1cd4d37b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.708642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649953a3-47c8-4b28-b83c-0bcf1cd4d37b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.721440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 323/649] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:35.722509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649953a3-47c8-4b28-b83c-0bcf1cd4d37b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.764972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8406e1-f49d-4d84-bb05-961ae8940fdd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.792018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.801769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6627f-e7ec-41d9-90cd-34c08d65feac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.802387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6627f-e7ec-41d9-90cd-34c08d65feac None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.803432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6627f-e7ec-41d9-90cd-34c08d65feac None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.803432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6627f-e7ec-41d9-90cd-34c08d65feac None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.803721 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6627f-e7ec-41d9-90cd-34c08d65feac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:35.804009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6627f-e7ec-41d9-90cd-34c08d65feac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.805454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6627f-e7ec-41d9-90cd-34c08d65feac None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.824792 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 327/650] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:35.824792 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6627f-e7ec-41d9-90cd-34c08d65feac None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.837525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649953a3-47c8-4b28-b83c-0bcf1cd4d37b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.838020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.872408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfca6b3-2be9-4524-bc07-40a9f1e197f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.873175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfca6b3-2be9-4524-bc07-40a9f1e197f1 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.873611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfca6b3-2be9-4524-bc07-40a9f1e197f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.874160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfca6b3-2be9-4524-bc07-40a9f1e197f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.927705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6627f-e7ec-41d9-90cd-34c08d65feac None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.948456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfca6b3-2be9-4524-bc07-40a9f1e197f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.950247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfca6b3-2be9-4524-bc07-40a9f1e197f1 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.962233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66307c7-a868-4c25-9ab2-851508c9a82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.963850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66307c7-a868-4c25-9ab2-851508c9a82d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.964185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66307c7-a868-4c25-9ab2-851508c9a82d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.964555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66307c7-a868-4c25-9ab2-851508c9a82d None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.965242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66307c7-a868-4c25-9ab2-851508c9a82d None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:35.965537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66307c7-a868-4c25-9ab2-851508c9a82d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.968426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66307c7-a868-4c25-9ab2-851508c9a82d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.982381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 328/651] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:35.982381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66307c7-a868-4c25-9ab2-851508c9a82d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.021465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.055480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.066667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 324/652] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:36.067770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfca6b3-2be9-4524-bc07-40a9f1e197f1 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.086582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66307c7-a868-4c25-9ab2-851508c9a82d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.122368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf11b1e-85d0-4ddd-9465-6f927b130c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.123134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf11b1e-85d0-4ddd-9465-6f927b130c04 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.124123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf11b1e-85d0-4ddd-9465-6f927b130c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.124524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf11b1e-85d0-4ddd-9465-6f927b130c04 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.132126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf11b1e-85d0-4ddd-9465-6f927b130c04 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.133696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf11b1e-85d0-4ddd-9465-6f927b130c04 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-eaf11b1e-85d0-4ddd-9465-6f927b130c04 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:36.145920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:36.147089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:36.148344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:36.148344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:36.148344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:36.148344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:36.148344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:36.148344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:36.148344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:36.148344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:36.148344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:36.148344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:36.154108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 329/653] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:36.154108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf11b1e-85d0-4ddd-9465-6f927b130c04 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.174537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfca6b3-2be9-4524-bc07-40a9f1e197f1 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.210494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216a510-f5c3-483e-9ef9-1b7a29cf80f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.211086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216a510-f5c3-483e-9ef9-1b7a29cf80f2 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.211361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216a510-f5c3-483e-9ef9-1b7a29cf80f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.211622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216a510-f5c3-483e-9ef9-1b7a29cf80f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.212323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216a510-f5c3-483e-9ef9-1b7a29cf80f2 None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=79efccae1afa46e78c25f617bf2dd9dd) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:36.212644 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216a510-f5c3-483e-9ef9-1b7a29cf80f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.214058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216a510-f5c3-483e-9ef9-1b7a29cf80f2 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.227283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 325/654] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/role_assignments?user.id=79efccae1afa46e78c25f617bf2dd9dd&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:36.227283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216a510-f5c3-483e-9ef9-1b7a29cf80f2 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.254544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.297093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf11b1e-85d0-4ddd-9465-6f927b130c04 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.339413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d9b0f-510c-425d-b364-1542e6e6275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.340443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d9b0f-510c-425d-b364-1542e6e6275f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.340840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d9b0f-510c-425d-b364-1542e6e6275f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.341624 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d9b0f-510c-425d-b364-1542e6e6275f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.344991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.346116 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216a510-f5c3-483e-9ef9-1b7a29cf80f2 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.356950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d9b0f-510c-425d-b364-1542e6e6275f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.359255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d9b0f-510c-425d-b364-1542e6e6275f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-405d9b0f-510c-425d-b364-1542e6e6275f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:36.380000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:36.381304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:36.382444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:36.382444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:36.382444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:36.384019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 330/655] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:36.385441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d9b0f-510c-425d-b364-1542e6e6275f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.391045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d752ca6-e9d2-4571-bbb0-95418ab83ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.391922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d752ca6-e9d2-4571-bbb0-95418ab83ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.392358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d752ca6-e9d2-4571-bbb0-95418ab83ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.392812 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d752ca6-e9d2-4571-bbb0-95418ab83ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.411516 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d752ca6-e9d2-4571-bbb0-95418ab83ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.413295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d752ca6-e9d2-4571-bbb0-95418ab83ce4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-8d752ca6-e9d2-4571-bbb0-95418ab83ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:36.437088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:36.438293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:36.439382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:36.439382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:36.439382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:36.441537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 326/656] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:36.442881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d752ca6-e9d2-4571-bbb0-95418ab83ce4 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.512737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d9b0f-510c-425d-b364-1542e6e6275f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.557627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.561530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec45e3-d064-4f2a-95bb-b8ec878cb143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.562141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec45e3-d064-4f2a-95bb-b8ec878cb143 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.562411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec45e3-d064-4f2a-95bb-b8ec878cb143 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.562672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec45e3-d064-4f2a-95bb-b8ec878cb143 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.563398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec45e3-d064-4f2a-95bb-b8ec878cb143 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:36.563694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec45e3-d064-4f2a-95bb-b8ec878cb143 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.565166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec45e3-d064-4f2a-95bb-b8ec878cb143 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.585420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 331/657] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:36.586433 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec45e3-d064-4f2a-95bb-b8ec878cb143 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.597608 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d752ca6-e9d2-4571-bbb0-95418ab83ce4 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.637774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.645493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d271db-4b22-4e49-a4a6-bba7141cd8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.646114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d271db-4b22-4e49-a4a6-bba7141cd8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.646433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d271db-4b22-4e49-a4a6-bba7141cd8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.646714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d271db-4b22-4e49-a4a6-bba7141cd8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.647814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d271db-4b22-4e49-a4a6-bba7141cd8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:36.648120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d271db-4b22-4e49-a4a6-bba7141cd8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.649856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d271db-4b22-4e49-a4a6-bba7141cd8c2 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.665503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 327/658] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:36.666373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d271db-4b22-4e49-a4a6-bba7141cd8c2 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.700493 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec45e3-d064-4f2a-95bb-b8ec878cb143 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.737250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18854e-ad9d-49d1-8e24-b26fd55a106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.737858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18854e-ad9d-49d1-8e24-b26fd55a106a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.738129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18854e-ad9d-49d1-8e24-b26fd55a106a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.738399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18854e-ad9d-49d1-8e24-b26fd55a106a None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.739033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18854e-ad9d-49d1-8e24-b26fd55a106a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:36.739329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18854e-ad9d-49d1-8e24-b26fd55a106a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.740717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18854e-ad9d-49d1-8e24-b26fd55a106a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.757723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 332/659] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:36.757723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af0631-e037-4497-a3c3-8b61613ad8d8 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.757723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af0631-e037-4497-a3c3-8b61613ad8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.757723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af0631-e037-4497-a3c3-8b61613ad8d8 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.757723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 333/660] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:36.758545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af0631-e037-4497-a3c3-8b61613ad8d8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.781345 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d271db-4b22-4e49-a4a6-bba7141cd8c2 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.818219 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b479cf3-1a10-43d7-9d19-1f668914d075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.819123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b479cf3-1a10-43d7-9d19-1f668914d075 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.819400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b479cf3-1a10-43d7-9d19-1f668914d075 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.819650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b479cf3-1a10-43d7-9d19-1f668914d075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.831433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.876465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af0631-e037-4497-a3c3-8b61613ad8d8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.879279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.894191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b479cf3-1a10-43d7-9d19-1f668914d075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.895677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b479cf3-1a10-43d7-9d19-1f668914d075 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.912967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19f48c-5f3f-40e3-8e32-ae933d3df0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.913649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f48c-5f3f-40e3-8e32-ae933d3df0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.913926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f48c-5f3f-40e3-8e32-ae933d3df0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.914425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f48c-5f3f-40e3-8e32-ae933d3df0f3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.921576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19f48c-5f3f-40e3-8e32-ae933d3df0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.922994 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19f48c-5f3f-40e3-8e32-ae933d3df0f3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-5e19f48c-5f3f-40e3-8e32-ae933d3df0f3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:36.934543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:36.935473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 334/661] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:36.941833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19f48c-5f3f-40e3-8e32-ae933d3df0f3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.011741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 328/662] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:37.011741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff146e93-3de2-4ee2-97ad-92c1cb249bfb None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.011741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff146e93-3de2-4ee2-97ad-92c1cb249bfb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.011741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff146e93-3de2-4ee2-97ad-92c1cb249bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.027787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ff146e93-3de2-4ee2-97ad-92c1cb249bfb None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:37.028997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ff146e93-3de2-4ee2-97ad-92c1cb249bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:37.050757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19f48c-5f3f-40e3-8e32-ae933d3df0f3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.066563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:37.089193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c0c3c-04af-4a23-847e-04c314bcae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.089745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c0c3c-04af-4a23-847e-04c314bcae98 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.090019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c0c3c-04af-4a23-847e-04c314bcae98 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.090285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c0c3c-04af-4a23-847e-04c314bcae98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.097197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c0c3c-04af-4a23-847e-04c314bcae98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.098632 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c0c3c-04af-4a23-847e-04c314bcae98 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.104679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 329/663] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:37.105671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff146e93-3de2-4ee2-97ad-92c1cb249bfb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-1f3c0c3c-04af-4a23-847e-04c314bcae98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:37.118473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:37.119575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:37.120690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:37.120690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:37.120690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:37.120690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:37.120690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:37.120690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:37.120690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:37.120690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:37.127921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 335/664] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:37.128097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c0c3c-04af-4a23-847e-04c314bcae98 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.153316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:37.216188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff146e93-3de2-4ee2-97ad-92c1cb249bfb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.239227 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c0c3c-04af-4a23-847e-04c314bcae98 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.250544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dddff-3640-4807-b218-25bf79a4c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.251149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dddff-3640-4807-b218-25bf79a4c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.251423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dddff-3640-4807-b218-25bf79a4c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.251691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dddff-3640-4807-b218-25bf79a4c9d4 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.252407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dddff-3640-4807-b218-25bf79a4c9d4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:37.252751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dddff-3640-4807-b218-25bf79a4c9d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.254157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dddff-3640-4807-b218-25bf79a4c9d4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.271101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 330/665] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:37.272067 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dddff-3640-4807-b218-25bf79a4c9d4 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.283124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003898-8e5f-45ab-8c7d-b66954414257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.283870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003898-8e5f-45ab-8c7d-b66954414257 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.284203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003898-8e5f-45ab-8c7d-b66954414257 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.284478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003898-8e5f-45ab-8c7d-b66954414257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.297676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003898-8e5f-45ab-8c7d-b66954414257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.299474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8003898-8e5f-45ab-8c7d-b66954414257 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.301404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f8003898-8e5f-45ab-8c7d-b66954414257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:37.315934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:37.316910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:37.317796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:37.317796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:37.317796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:37.317796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 336/666] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:37.317796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003898-8e5f-45ab-8c7d-b66954414257 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.382932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dddff-3640-4807-b218-25bf79a4c9d4 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.396519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:37.424091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a0d19-5191-44de-99c3-06ca7f7194cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.424744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0d19-5191-44de-99c3-06ca7f7194cf None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.425018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0d19-5191-44de-99c3-06ca7f7194cf None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.425277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0d19-5191-44de-99c3-06ca7f7194cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.425911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8003898-8e5f-45ab-8c7d-b66954414257 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.437527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a0d19-5191-44de-99c3-06ca7f7194cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-ac6a0d19-5191-44de-99c3-06ca7f7194cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:37.442110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:37.443046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:37.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 331/667] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:37.444916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a0d19-5191-44de-99c3-06ca7f7194cf None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.467508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518ea38-2b4e-48f6-8e69-cc095c5973b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.468121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518ea38-2b4e-48f6-8e69-cc095c5973b6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.468397 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518ea38-2b4e-48f6-8e69-cc095c5973b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.468691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518ea38-2b4e-48f6-8e69-cc095c5973b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.469380 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518ea38-2b4e-48f6-8e69-cc095c5973b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:37.469683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518ea38-2b4e-48f6-8e69-cc095c5973b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.471099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518ea38-2b4e-48f6-8e69-cc095c5973b6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.483684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 337/668] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:37.484320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518ea38-2b4e-48f6-8e69-cc095c5973b6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.553451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:37.568569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a0d19-5191-44de-99c3-06ca7f7194cf None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.591391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518ea38-2b4e-48f6-8e69-cc095c5973b6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.604998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018adc0-7d75-4a3e-8705-fc2f6e48bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.605602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018adc0-7d75-4a3e-8705-fc2f6e48bc9e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.605883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018adc0-7d75-4a3e-8705-fc2f6e48bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.606167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018adc0-7d75-4a3e-8705-fc2f6e48bc9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.629201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8959d2-1f44-4337-ae3f-00d3c294dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.630038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8959d2-1f44-4337-ae3f-00d3c294dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.630318 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8959d2-1f44-4337-ae3f-00d3c294dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.630595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8959d2-1f44-4337-ae3f-00d3c294dfe2 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.631232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8959d2-1f44-4337-ae3f-00d3c294dfe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:37.631532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8959d2-1f44-4337-ae3f-00d3c294dfe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.632922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8959d2-1f44-4337-ae3f-00d3c294dfe2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.635337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:37.648945 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 338/669] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:37.650473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8959d2-1f44-4337-ae3f-00d3c294dfe2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.683079 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018adc0-7d75-4a3e-8705-fc2f6e48bc9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.684847 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018adc0-7d75-4a3e-8705-fc2f6e48bc9e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.752494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8959d2-1f44-4337-ae3f-00d3c294dfe2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.781173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:37.785292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961654-1ea7-48e9-a2cf-73d5cbd53ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.785888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961654-1ea7-48e9-a2cf-73d5cbd53ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.786165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961654-1ea7-48e9-a2cf-73d5cbd53ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.786436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961654-1ea7-48e9-a2cf-73d5cbd53ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.787075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961654-1ea7-48e9-a2cf-73d5cbd53ea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:37.787372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961654-1ea7-48e9-a2cf-73d5cbd53ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.788759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961654-1ea7-48e9-a2cf-73d5cbd53ea4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.797147 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 332/670] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:37.798178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018adc0-7d75-4a3e-8705-fc2f6e48bc9e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.802150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 339/671] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:37.803098 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961654-1ea7-48e9-a2cf-73d5cbd53ea4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.862915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:37.908398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961654-1ea7-48e9-a2cf-73d5cbd53ea4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.912310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018adc0-7d75-4a3e-8705-fc2f6e48bc9e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.944207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee78bc-ec75-4235-ba9e-786baf494439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.944867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee78bc-ec75-4235-ba9e-786baf494439 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.945144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee78bc-ec75-4235-ba9e-786baf494439 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.945418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee78bc-ec75-4235-ba9e-786baf494439 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.952558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee78bc-ec75-4235-ba9e-786baf494439 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.954019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee78bc-ec75-4235-ba9e-786baf494439 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.962819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef58fe7-5426-4a34-9700-6d65d10dc563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.963671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef58fe7-5426-4a34-9700-6d65d10dc563 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.964124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef58fe7-5426-4a34-9700-6d65d10dc563 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.964569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef58fe7-5426-4a34-9700-6d65d10dc563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7dee78bc-ec75-4235-ba9e-786baf494439 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:37.965329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:37.966193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:37.967207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:37.967207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:37.967207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:37.967207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:37.967207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:37.967207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:37.967207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:37.967207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:37.967207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 340/672] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:37.967207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee78bc-ec75-4235-ba9e-786baf494439 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.968205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef58fe7-5426-4a34-9700-6d65d10dc563 None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=98925192a33544e081f1a02faed60b7f) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:37.968522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef58fe7-5426-4a34-9700-6d65d10dc563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.969978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef58fe7-5426-4a34-9700-6d65d10dc563 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.976897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 333/673] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/role_assignments?user.id=98925192a33544e081f1a02faed60b7f&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:37.977949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef58fe7-5426-4a34-9700-6d65d10dc563 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:38.048391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:38.109148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef58fe7-5426-4a34-9700-6d65d10dc563 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:38.117672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee78bc-ec75-4235-ba9e-786baf494439 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:38.145047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:38.149141 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abc737-df74-4f7f-96cc-b2c3d9bd13d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:38.149963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abc737-df74-4f7f-96cc-b2c3d9bd13d8 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:38.150337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abc737-df74-4f7f-96cc-b2c3d9bd13d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:38.150688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abc737-df74-4f7f-96cc-b2c3d9bd13d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:38.164708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abc737-df74-4f7f-96cc-b2c3d9bd13d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:38.166125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abc737-df74-4f7f-96cc-b2c3d9bd13d8 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:38.183289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cac89-8bfe-4853-9e0b-f84147f0503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:38.183917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cac89-8bfe-4853-9e0b-f84147f0503b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:38.184188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cac89-8bfe-4853-9e0b-f84147f0503b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:38.184450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cac89-8bfe-4853-9e0b-f84147f0503b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-e6abc737-df74-4f7f-96cc-b2c3d9bd13d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:38.187663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:38.188578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:38.189906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:38.189906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:38.189906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:38.189906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 334/674] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:38.189906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abc737-df74-4f7f-96cc-b2c3d9bd13d8 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:38.196413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cac89-8bfe-4853-9e0b-f84147f0503b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:38.197923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cac89-8bfe-4853-9e0b-f84147f0503b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-103cac89-8bfe-4853-9e0b-f84147f0503b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:38.216841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:38.218610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:38.219646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:38.219646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:38.219646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:38.221650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 341/675] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:38.223240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cac89-8bfe-4853-9e0b-f84147f0503b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:38.320998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abc737-df74-4f7f-96cc-b2c3d9bd13d8 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:38.324398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:38.359341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5831d16-1d1d-4ffc-ad83-c6e0ab5f87fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:38.360233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cac89-8bfe-4853-9e0b-f84147f0503b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:38.360368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5831d16-1d1d-4ffc-ad83-c6e0ab5f87fa None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:38.360800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5831d16-1d1d-4ffc-ad83-c6e0ab5f87fa None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:38.361268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5831d16-1d1d-4ffc-ad83-c6e0ab5f87fa None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:38.362109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5831d16-1d1d-4ffc-ad83-c6e0ab5f87fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:38.362619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5831d16-1d1d-4ffc-ad83-c6e0ab5f87fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:38.364254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5831d16-1d1d-4ffc-ad83-c6e0ab5f87fa None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:38.378245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 335/676] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:38.379273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5831d16-1d1d-4ffc-ad83-c6e0ab5f87fa None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:38.411550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff76ac8-5f05-4a96-b184-5f35b38a9ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:38.412539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff76ac8-5f05-4a96-b184-5f35b38a9ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:38.412998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff76ac8-5f05-4a96-b184-5f35b38a9ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:38.413414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff76ac8-5f05-4a96-b184-5f35b38a9ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:38.420050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff76ac8-5f05-4a96-b184-5f35b38a9ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:38.421223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff76ac8-5f05-4a96-b184-5f35b38a9ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:38.422927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff76ac8-5f05-4a96-b184-5f35b38a9ce5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:38.441339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 342/677] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:38.442863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff76ac8-5f05-4a96-b184-5f35b38a9ce5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:38.473771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:38.496704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5831d16-1d1d-4ffc-ad83-c6e0ab5f87fa None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:38.533576 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea0f25-4daf-40f3-94f1-ac01f071af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:38.534184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea0f25-4daf-40f3-94f1-ac01f071af9f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:38.534460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea0f25-4daf-40f3-94f1-ac01f071af9f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:38.534728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea0f25-4daf-40f3-94f1-ac01f071af9f None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:38.535364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea0f25-4daf-40f3-94f1-ac01f071af9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:38.535683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea0f25-4daf-40f3-94f1-ac01f071af9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:38.537127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea0f25-4daf-40f3-94f1-ac01f071af9f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:38.548885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 336/678] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:38.550126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7d4bd-c6f3-4fcb-a4cd-8594b613049a None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:38.550410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7d4bd-c6f3-4fcb-a4cd-8594b613049a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:38.550680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7d4bd-c6f3-4fcb-a4cd-8594b613049a None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:38.552216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 337/679] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:38.552891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7d4bd-c6f3-4fcb-a4cd-8594b613049a None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:38.560392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff76ac8-5f05-4a96-b184-5f35b38a9ce5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:38.583184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:38.608197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d83f-4d99-4f57-b12e-9f353870ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:38.609032 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d83f-4d99-4f57-b12e-9f353870ef03 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:38.609312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d83f-4d99-4f57-b12e-9f353870ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:38.609575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d83f-4d99-4f57-b12e-9f353870ef03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:38.610364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2d83f-4d99-4f57-b12e-9f353870ef03 None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=f0b215bfb43742678bd5a728973dbc46) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:38.610670 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2d83f-4d99-4f57-b12e-9f353870ef03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:38.612088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2d83f-4d99-4f57-b12e-9f353870ef03 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:38.618094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 343/680] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:38 2022] GET /identity/v3/role_assignments?user.id=f0b215bfb43742678bd5a728973dbc46&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:38.626027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d83f-4d99-4f57-b12e-9f353870ef03 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:38.700840 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7d4bd-c6f3-4fcb-a4cd-8594b613049a None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:38.750028 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:38.754889 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fcf19-08ad-44ff-90c3-f07cf2fef145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:38.756788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fcf19-08ad-44ff-90c3-f07cf2fef145 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:38.757516 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fcf19-08ad-44ff-90c3-f07cf2fef145 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:38.758013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fcf19-08ad-44ff-90c3-f07cf2fef145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:38.759597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d83f-4d99-4f57-b12e-9f353870ef03 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:38.767676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fcf19-08ad-44ff-90c3-f07cf2fef145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:38.770807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fcf19-08ad-44ff-90c3-f07cf2fef145 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-103fcf19-08ad-44ff-90c3-f07cf2fef145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:38.785012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:38.785979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:38.786854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:38.786854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:38.786854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:38.786854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:38.786854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:38.786854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:38.786854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:38.786854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:38.786854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 338/681] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:38.787806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720e299-08c5-4473-ae4f-2b785a3c0d45 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:38.787980 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720e299-08c5-4473-ae4f-2b785a3c0d45 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:38.788520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720e299-08c5-4473-ae4f-2b785a3c0d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:38.809193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-1720e299-08c5-4473-ae4f-2b785a3c0d45 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:38.810380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1720e299-08c5-4473-ae4f-2b785a3c0d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:38.811657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438fe88-2a6b-4b8b-9324-bcee1846a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:38.812342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438fe88-2a6b-4b8b-9324-bcee1846a20e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:38.812641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438fe88-2a6b-4b8b-9324-bcee1846a20e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:38.813007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438fe88-2a6b-4b8b-9324-bcee1846a20e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:38.823101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438fe88-2a6b-4b8b-9324-bcee1846a20e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:38.824735 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438fe88-2a6b-4b8b-9324-bcee1846a20e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-6438fe88-2a6b-4b8b-9324-bcee1846a20e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:38.838941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:38.839965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 344/682] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:38.841043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438fe88-2a6b-4b8b-9324-bcee1846a20e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:38.895056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 339/683] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:38.896680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720e299-08c5-4473-ae4f-2b785a3c0d45 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:38.924016 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:38.985914 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438fe88-2a6b-4b8b-9324-bcee1846a20e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:39.025606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720e299-08c5-4473-ae4f-2b785a3c0d45 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:39.032287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6e385-8d4b-4f9b-bd06-b29d71ca3d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:39.032925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6e385-8d4b-4f9b-bd06-b29d71ca3d10 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:39.033742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6e385-8d4b-4f9b-bd06-b29d71ca3d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:39.034020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6e385-8d4b-4f9b-bd06-b29d71ca3d10 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:39.034708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6e385-8d4b-4f9b-bd06-b29d71ca3d10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:39.035190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6e385-8d4b-4f9b-bd06-b29d71ca3d10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:39.037648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6e385-8d4b-4f9b-bd06-b29d71ca3d10 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:39.056719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 345/684] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:39.057577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6e385-8d4b-4f9b-bd06-b29d71ca3d10 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:39.073676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a123-8978-4671-8b88-435068fd656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:39.074585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a123-8978-4671-8b88-435068fd656b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:39.074875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a123-8978-4671-8b88-435068fd656b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:39.075146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8a123-8978-4671-8b88-435068fd656b None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:39.076122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8a123-8978-4671-8b88-435068fd656b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:39.076439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8a123-8978-4671-8b88-435068fd656b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:39.078038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:39.080800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8a123-8978-4671-8b88-435068fd656b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:39.105771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 340/685] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 9 12:09:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:39.106825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a123-8978-4671-8b88-435068fd656b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:39.192898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6e385-8d4b-4f9b-bd06-b29d71ca3d10 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:39.195687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:39.230708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8a123-8978-4671-8b88-435068fd656b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:39.238143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa583ee-62d0-4c09-b409-181d0a69911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:39.238713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa583ee-62d0-4c09-b409-181d0a69911d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:39.238989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa583ee-62d0-4c09-b409-181d0a69911d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:39.239299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa583ee-62d0-4c09-b409-181d0a69911d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:39.251179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa583ee-62d0-4c09-b409-181d0a69911d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:39.253012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa583ee-62d0-4c09-b409-181d0a69911d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-cfa583ee-62d0-4c09-b409-181d0a69911d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:39.271657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:39.272839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:39.273980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:39.273980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:39.273980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:39.275834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d9cde-b722-437e-9c9f-071317a4e94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:39.276011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 346/686] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:39.276297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9cde-b722-437e-9c9f-071317a4e94b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:39.276574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9cde-b722-437e-9c9f-071317a4e94b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:39.277286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa583ee-62d0-4c09-b409-181d0a69911d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:39.282127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9cde-b722-437e-9c9f-071317a4e94b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:39.282944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d9cde-b722-437e-9c9f-071317a4e94b None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=13063cbf860c4ca98666500c3c125933) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:39.283266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d9cde-b722-437e-9c9f-071317a4e94b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:39.284736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d9cde-b722-437e-9c9f-071317a4e94b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:39.296653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 341/687] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:39 2022] GET /identity/v3/role_assignments?user.id=13063cbf860c4ca98666500c3c125933&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:39.296653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d9cde-b722-437e-9c9f-071317a4e94b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:39.454473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:39.458960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d9cde-b722-437e-9c9f-071317a4e94b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:39.513784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309309-353f-4df9-a630-d566ee751a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:39.514702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa583ee-62d0-4c09-b409-181d0a69911d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:39.514983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309309-353f-4df9-a630-d566ee751a19 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:39.515158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309309-353f-4df9-a630-d566ee751a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:39.515370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309309-353f-4df9-a630-d566ee751a19 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:39.516013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309309-353f-4df9-a630-d566ee751a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:39.516320 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309309-353f-4df9-a630-d566ee751a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:39.517708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309309-353f-4df9-a630-d566ee751a19 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:39.520124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:39.534968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 342/688] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:39.540779 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309309-353f-4df9-a630-d566ee751a19 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:39.559115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146dc22-1e8d-4dfe-8614-2109ba999ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:39.559728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146dc22-1e8d-4dfe-8614-2109ba999ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:39.560007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146dc22-1e8d-4dfe-8614-2109ba999ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:39.560279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146dc22-1e8d-4dfe-8614-2109ba999ef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:39.663719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146dc22-1e8d-4dfe-8614-2109ba999ef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:39.665777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146dc22-1e8d-4dfe-8614-2109ba999ef2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:39.681504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309309-353f-4df9-a630-d566ee751a19 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:39.746213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:39.755012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20d1e9-f2f7-4550-9096-c1689b9bce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:39.755589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d1e9-f2f7-4550-9096-c1689b9bce51 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:39.755874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d1e9-f2f7-4550-9096-c1689b9bce51 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:39.756145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d1e9-f2f7-4550-9096-c1689b9bce51 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:39.756817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20d1e9-f2f7-4550-9096-c1689b9bce51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:39.758257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20d1e9-f2f7-4550-9096-c1689b9bce51 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:39.783007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 343/689] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:39 2022] POST /identity/v3/users => generated 254 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:39.798945 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 347/690] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:39.805792 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20d1e9-f2f7-4550-9096-c1689b9bce51 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:39.903661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:39.967739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20d1e9-f2f7-4550-9096-c1689b9bce51 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.002728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00201e8c-4495-4eb0-b586-42b54badbdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.003359 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00201e8c-4495-4eb0-b586-42b54badbdad None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.003693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00201e8c-4495-4eb0-b586-42b54badbdad None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.004007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00201e8c-4495-4eb0-b586-42b54badbdad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.015460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00201e8c-4495-4eb0-b586-42b54badbdad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.016931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00201e8c-4495-4eb0-b586-42b54badbdad None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-00201e8c-4495-4eb0-b586-42b54badbdad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:40.031928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:40.032922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:40.033850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:40.033850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:40.033850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:40.033850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 344/691] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:40.040000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146dc22-1e8d-4dfe-8614-2109ba999ef2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.152401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146dc22-1e8d-4dfe-8614-2109ba999ef2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.193183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afad3c-a022-4ca0-bc70-117825187f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.193806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afad3c-a022-4ca0-bc70-117825187f67 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.194081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afad3c-a022-4ca0-bc70-117825187f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.194349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afad3c-a022-4ca0-bc70-117825187f67 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.194991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afad3c-a022-4ca0-bc70-117825187f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:40.195290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afad3c-a022-4ca0-bc70-117825187f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.196820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afad3c-a022-4ca0-bc70-117825187f67 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.212087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 348/692] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:40.217312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00201e8c-4495-4eb0-b586-42b54badbdad None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.341118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00201e8c-4495-4eb0-b586-42b54badbdad None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.348170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.350755 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8d0ca-c3df-4cb4-9a56-167e7276dcf0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.351061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8d0ca-c3df-4cb4-9a56-167e7276dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.351376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8d0ca-c3df-4cb4-9a56-167e7276dcf0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.355790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 349/693] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:40.361352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ca900-a6b2-4da3-a955-1914197e43c3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.361352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ca900-a6b2-4da3-a955-1914197e43c3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.361352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ca900-a6b2-4da3-a955-1914197e43c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.382692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6d1ca900-a6b2-4da3-a955-1914197e43c3 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:40.384246 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6d1ca900-a6b2-4da3-a955-1914197e43c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:40.420674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.420959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc507-1b77-4cbd-857e-0681900ff65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.420959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc507-1b77-4cbd-857e-0681900ff65e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.420959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc507-1b77-4cbd-857e-0681900ff65e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.420959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bc507-1b77-4cbd-857e-0681900ff65e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.431864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bc507-1b77-4cbd-857e-0681900ff65e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.433711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bc507-1b77-4cbd-857e-0681900ff65e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-c15bc507-1b77-4cbd-857e-0681900ff65e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:40.463198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:40.464357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:40.465463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:40.465463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:40.465463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:40.465463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:40.465463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:40.465463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:40.465463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:40.465463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:40.472756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 345/694] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:40.475780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc507-1b77-4cbd-857e-0681900ff65e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.512385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 350/695] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:40.560290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ca900-a6b2-4da3-a955-1914197e43c3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.619793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bc507-1b77-4cbd-857e-0681900ff65e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.699798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf683a-f0a1-4da2-b43e-6fe0fe054ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.700419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf683a-f0a1-4da2-b43e-6fe0fe054ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.700725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf683a-f0a1-4da2-b43e-6fe0fe054ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.700999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf683a-f0a1-4da2-b43e-6fe0fe054ec6 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.701739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf683a-f0a1-4da2-b43e-6fe0fe054ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:40.702040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf683a-f0a1-4da2-b43e-6fe0fe054ec6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.703479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf683a-f0a1-4da2-b43e-6fe0fe054ec6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.732327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 346/696] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:40.739070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf683a-f0a1-4da2-b43e-6fe0fe054ec6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.743052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ca900-a6b2-4da3-a955-1914197e43c3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.784655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91481d-ba40-4e36-89ea-d0e2ec57c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.784655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91481d-ba40-4e36-89ea-d0e2ec57c1dd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.784655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91481d-ba40-4e36-89ea-d0e2ec57c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.784655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91481d-ba40-4e36-89ea-d0e2ec57c1dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.792917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.797847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91481d-ba40-4e36-89ea-d0e2ec57c1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-5d91481d-ba40-4e36-89ea-d0e2ec57c1dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:40.803104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:40.804016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:40.804883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 351/697] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:40.811966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91481d-ba40-4e36-89ea-d0e2ec57c1dd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.841047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.928097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91481d-ba40-4e36-89ea-d0e2ec57c1dd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.945589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf683a-f0a1-4da2-b43e-6fe0fe054ec6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.972332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e7336-ceb4-4267-a29d-1ff97f7e372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.973244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e7336-ceb4-4267-a29d-1ff97f7e372e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.973538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e7336-ceb4-4267-a29d-1ff97f7e372e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.973811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e7336-ceb4-4267-a29d-1ff97f7e372e None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.974477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e7336-ceb4-4267-a29d-1ff97f7e372e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:40.974784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e7336-ceb4-4267-a29d-1ff97f7e372e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.976846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e7336-ceb4-4267-a29d-1ff97f7e372e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.984746 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58d6a4-6e5c-430b-93bd-b4bdd964bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.985601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d6a4-6e5c-430b-93bd-b4bdd964bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.986140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d6a4-6e5c-430b-93bd-b4bdd964bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.986625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d6a4-6e5c-430b-93bd-b4bdd964bfc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.987575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58d6a4-6e5c-430b-93bd-b4bdd964bfc5 None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=20f9b96629544596a8d9b81cce57af21) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:40.988126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58d6a4-6e5c-430b-93bd-b4bdd964bfc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.988245 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 352/698] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:40.989949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58d6a4-6e5c-430b-93bd-b4bdd964bfc5 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.993575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eee3b1-a09c-4054-85f2-2ac60a6fac86 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.995101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eee3b1-a09c-4054-85f2-2ac60a6fac86 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.996576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eee3b1-a09c-4054-85f2-2ac60a6fac86 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.001517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 353/699] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:41.003711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eee3b1-a09c-4054-85f2-2ac60a6fac86 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.008895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 347/700] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/role_assignments?user.id=20f9b96629544596a8d9b81cce57af21&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:41.008895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdb2df-ac96-4c4b-9ee8-9f99341cec70 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.008895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdb2df-ac96-4c4b-9ee8-9f99341cec70 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.008895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdb2df-ac96-4c4b-9ee8-9f99341cec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.028674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d2cdb2df-ac96-4c4b-9ee8-9f99341cec70 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:41.030077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d2cdb2df-ac96-4c4b-9ee8-9f99341cec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:41.118806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 348/701] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:41.149189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:41.153903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdb2df-ac96-4c4b-9ee8-9f99341cec70 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.185551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eee3b1-a09c-4054-85f2-2ac60a6fac86 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.207489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:41.261132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b091d55-fc04-47ac-8f74-0fd6e40e757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.262143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b091d55-fc04-47ac-8f74-0fd6e40e757a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.262781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b091d55-fc04-47ac-8f74-0fd6e40e757a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.263252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b091d55-fc04-47ac-8f74-0fd6e40e757a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.284970 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b091d55-fc04-47ac-8f74-0fd6e40e757a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.286415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b091d55-fc04-47ac-8f74-0fd6e40e757a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3b091d55-fc04-47ac-8f74-0fd6e40e757a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:41.310550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:41.312151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:41.313563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:41.313563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:41.313563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:41.316001 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 354/702] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:41.321494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b091d55-fc04-47ac-8f74-0fd6e40e757a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.353499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdb2df-ac96-4c4b-9ee8-9f99341cec70 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.394600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e56735-c781-43d7-83fd-94cc16c897e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.395572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e56735-c781-43d7-83fd-94cc16c897e6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.396017 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e56735-c781-43d7-83fd-94cc16c897e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.396380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e56735-c781-43d7-83fd-94cc16c897e6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.397163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e56735-c781-43d7-83fd-94cc16c897e6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.398733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e56735-c781-43d7-83fd-94cc16c897e6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-52e56735-c781-43d7-83fd-94cc16c897e6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:41.410399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:41.411680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:09:41.412534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:41.413406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 349/703] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:41.420729 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e56735-c781-43d7-83fd-94cc16c897e6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.471110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b091d55-fc04-47ac-8f74-0fd6e40e757a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.504859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:41.512767 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e36564-2f04-48ca-b939-547f3660ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.513375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e36564-2f04-48ca-b939-547f3660ec30 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.513652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e36564-2f04-48ca-b939-547f3660ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.514054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e36564-2f04-48ca-b939-547f3660ec30 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.514703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e36564-2f04-48ca-b939-547f3660ec30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:41.514995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e36564-2f04-48ca-b939-547f3660ec30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.516464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e36564-2f04-48ca-b939-547f3660ec30 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.518962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:41.536650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 355/704] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:41.546365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e36564-2f04-48ca-b939-547f3660ec30 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.559929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e56735-c781-43d7-83fd-94cc16c897e6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.629383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0bc18-1fd5-48f7-b21e-8e8d3283ea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.630386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0bc18-1fd5-48f7-b21e-8e8d3283ea59 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.636982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0bc18-1fd5-48f7-b21e-8e8d3283ea59 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.637462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0bc18-1fd5-48f7-b21e-8e8d3283ea59 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.638291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0bc18-1fd5-48f7-b21e-8e8d3283ea59 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:41.638807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0bc18-1fd5-48f7-b21e-8e8d3283ea59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.640434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0bc18-1fd5-48f7-b21e-8e8d3283ea59 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.648756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 350/705] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:41.666004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0bc18-1fd5-48f7-b21e-8e8d3283ea59 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.680193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e36564-2f04-48ca-b939-547f3660ec30 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.717636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f73bcf-5596-41da-8d8d-33960fb29a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.718376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f73bcf-5596-41da-8d8d-33960fb29a45 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.718660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f73bcf-5596-41da-8d8d-33960fb29a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.718928 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f73bcf-5596-41da-8d8d-33960fb29a45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.726610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f73bcf-5596-41da-8d8d-33960fb29a45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.728055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f73bcf-5596-41da-8d8d-33960fb29a45 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-57f73bcf-5596-41da-8d8d-33960fb29a45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:41.740969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:41.741957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:41.742919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:41.742919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:41.742919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:41.742919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:41.742919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:41.742919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:41.742919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:41.742919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:41.742919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:41.742919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:41.756901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 356/706] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:41.758602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f73bcf-5596-41da-8d8d-33960fb29a45 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.816923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:41.870109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0bc18-1fd5-48f7-b21e-8e8d3283ea59 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.879513 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f73bcf-5596-41da-8d8d-33960fb29a45 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.923114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c71f2-dab8-4c17-9eae-0a3d1eee290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.924307 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c71f2-dab8-4c17-9eae-0a3d1eee290f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.924770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c71f2-dab8-4c17-9eae-0a3d1eee290f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.925235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c71f2-dab8-4c17-9eae-0a3d1eee290f None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.926719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c71f2-dab8-4c17-9eae-0a3d1eee290f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:41.927194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c71f2-dab8-4c17-9eae-0a3d1eee290f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.929174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c71f2-dab8-4c17-9eae-0a3d1eee290f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.936816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715667d7-577f-4d9b-b050-7e1bf0945a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.938923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715667d7-577f-4d9b-b050-7e1bf0945a19 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.940037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715667d7-577f-4d9b-b050-7e1bf0945a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.941410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715667d7-577f-4d9b-b050-7e1bf0945a19 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.941410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715667d7-577f-4d9b-b050-7e1bf0945a19 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:41.942893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715667d7-577f-4d9b-b050-7e1bf0945a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.946409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715667d7-577f-4d9b-b050-7e1bf0945a19 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.950653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 357/707] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:41.954301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab29ed3-df3e-4ade-b688-8967970ae6f9 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.954726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab29ed3-df3e-4ade-b688-8967970ae6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.955125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab29ed3-df3e-4ade-b688-8967970ae6f9 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.957002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 358/708] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:41.957919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab29ed3-df3e-4ade-b688-8967970ae6f9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.966098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 351/709] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:41.967638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117cdf-6d3f-4250-8940-547a267dbc01 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.969658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117cdf-6d3f-4250-8940-547a267dbc01 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.969833 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117cdf-6d3f-4250-8940-547a267dbc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:42.015075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d4117cdf-6d3f-4250-8940-547a267dbc01 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:42.017773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d4117cdf-6d3f-4250-8940-547a267dbc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:42.032682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:42.108501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab29ed3-df3e-4ade-b688-8967970ae6f9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:42.120790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:42.166241 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13053459-2cb3-429c-8d25-1eb12bbd1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:42.167178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13053459-2cb3-429c-8d25-1eb12bbd1f55 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:42.167711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13053459-2cb3-429c-8d25-1eb12bbd1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:42.168211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13053459-2cb3-429c-8d25-1eb12bbd1f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:42.184556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 352/710] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:42.220727 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4117cdf-6d3f-4250-8940-547a267dbc01 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:42.426894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4117cdf-6d3f-4250-8940-547a267dbc01 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:42.462765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f670518-cff1-40e8-aa77-f8d648305560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:42.463404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f670518-cff1-40e8-aa77-f8d648305560 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:42.463682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f670518-cff1-40e8-aa77-f8d648305560 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:42.463952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f670518-cff1-40e8-aa77-f8d648305560 None admin] PATH_INFO: `/v3/services/network` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:42.464534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f670518-cff1-40e8-aa77-f8d648305560 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:42.466050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f670518-cff1-40e8-aa77-f8d648305560 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-2f670518-cff1-40e8-aa77-f8d648305560 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:42.476045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:42.477198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:42.478284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 353/711] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:42 2022] GET /identity/v3/services/network => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:42.483329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f670518-cff1-40e8-aa77-f8d648305560 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:42.520701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:42.521467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13053459-2cb3-429c-8d25-1eb12bbd1f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:42.522987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13053459-2cb3-429c-8d25-1eb12bbd1f55 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:42.588671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f670518-cff1-40e8-aa77-f8d648305560 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:42.638505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8845a-cea3-4151-9861-e493be6da6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:42.640288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8845a-cea3-4151-9861-e493be6da6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:42.642225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8845a-cea3-4151-9861-e493be6da6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:42.642642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8845a-cea3-4151-9861-e493be6da6b3 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:42.643414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8845a-cea3-4151-9861-e493be6da6b3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:42.643855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8845a-cea3-4151-9861-e493be6da6b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:42.646282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8845a-cea3-4151-9861-e493be6da6b3 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:42.656565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 354/712] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:09:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:42.659196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bb773-d9f8-4f1f-983d-ff1dea49b91d None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:42.659620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bb773-d9f8-4f1f-983d-ff1dea49b91d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:42.660742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bb773-d9f8-4f1f-983d-ff1dea49b91d None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:42.662820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 355/713] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:42.663837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bb773-d9f8-4f1f-983d-ff1dea49b91d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:42.720651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 359/714] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 763 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:42.722224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d17849-59b9-449f-830d-65ed7ef11b1d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:42.722508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d17849-59b9-449f-830d-65ed7ef11b1d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:42.722780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d17849-59b9-449f-830d-65ed7ef11b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:42.744672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-70d17849-59b9-449f-830d-65ed7ef11b1d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:42.746160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-70d17849-59b9-449f-830d-65ed7ef11b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:42.749075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:42.752226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:42.801408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bb773-d9f8-4f1f-983d-ff1dea49b91d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:42.827768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 360/715] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:42.835114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d17849-59b9-449f-830d-65ed7ef11b1d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:42.857172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afd2e-0a31-4b65-ac0d-83f95873ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:42.858468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afd2e-0a31-4b65-ac0d-83f95873ae40 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:42.858849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afd2e-0a31-4b65-ac0d-83f95873ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:42.859064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afd2e-0a31-4b65-ac0d-83f95873ae40 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:42.859804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afd2e-0a31-4b65-ac0d-83f95873ae40 None admin] RBAC: Adding query filter params (type=network) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:42.860108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afd2e-0a31-4b65-ac0d-83f95873ae40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:42.861610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afd2e-0a31-4b65-ac0d-83f95873ae40 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:42.867667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 356/716] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:09:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:42.868617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afd2e-0a31-4b65-ac0d-83f95873ae40 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:43.005730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d17849-59b9-449f-830d-65ed7ef11b1d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.051225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b8e84-1ea7-44b3-ae34-9ef999c92e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:43.052372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b8e84-1ea7-44b3-ae34-9ef999c92e7a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.052894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b8e84-1ea7-44b3-ae34-9ef999c92e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.053385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b8e84-1ea7-44b3-ae34-9ef999c92e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.060827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:43.066310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b8e84-1ea7-44b3-ae34-9ef999c92e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:43.069036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b8e84-1ea7-44b3-ae34-9ef999c92e7a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:43.078019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afd2e-0a31-4b65-ac0d-83f95873ae40 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-164b8e84-1ea7-44b3-ae34-9ef999c92e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:43.085998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:43.086961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:43.087836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:43.087836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:43.087836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:43.087836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 361/717] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:43.095589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b8e84-1ea7-44b3-ae34-9ef999c92e7a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:43.126893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:43.132966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b7ed9-b7ee-43ae-8e33-34b2686e274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:43.133593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b7ed9-b7ee-43ae-8e33-34b2686e274a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.133869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b7ed9-b7ee-43ae-8e33-34b2686e274a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.134160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b7ed9-b7ee-43ae-8e33-34b2686e274a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.150349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b7ed9-b7ee-43ae-8e33-34b2686e274a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-d15b7ed9-b7ee-43ae-8e33-34b2686e274a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:43.155911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:43.156866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:43.157720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 357/718] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:43.163598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b7ed9-b7ee-43ae-8e33-34b2686e274a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:43.229346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b8e84-1ea7-44b3-ae34-9ef999c92e7a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.269704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d3ef-f82c-4cd1-8b9d-d68f2872b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:43.270734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d3ef-f82c-4cd1-8b9d-d68f2872b16f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.271230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d3ef-f82c-4cd1-8b9d-d68f2872b16f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.271866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d3ef-f82c-4cd1-8b9d-d68f2872b16f None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.272764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d3ef-f82c-4cd1-8b9d-d68f2872b16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:43.273385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d3ef-f82c-4cd1-8b9d-d68f2872b16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:43.274959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d3ef-f82c-4cd1-8b9d-d68f2872b16f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:43.289709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 362/719] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:43.296448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d3ef-f82c-4cd1-8b9d-d68f2872b16f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:43.356975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:43.417291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d3ef-f82c-4cd1-8b9d-d68f2872b16f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.438071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b7ed9-b7ee-43ae-8e33-34b2686e274a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.458201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f092-adf6-45f3-9384-7f9aea91c019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:43.459533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f092-adf6-45f3-9384-7f9aea91c019 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.460046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f092-adf6-45f3-9384-7f9aea91c019 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.460526 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f092-adf6-45f3-9384-7f9aea91c019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.468384 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6f092-adf6-45f3-9384-7f9aea91c019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:43.470695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6f092-adf6-45f3-9384-7f9aea91c019 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-82a6f092-adf6-45f3-9384-7f9aea91c019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:43.483035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:43.484090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:43.485005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:43.485005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:43.485005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:43.485005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:43.485005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:43.485005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:43.485005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:43.485005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:43.489227 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 363/720] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:43.495124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f092-adf6-45f3-9384-7f9aea91c019 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:43.547498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e3a83-f23c-4751-b39c-9e433019432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:43.548086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e3a83-f23c-4751-b39c-9e433019432b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.548386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e3a83-f23c-4751-b39c-9e433019432b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.548950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e3a83-f23c-4751-b39c-9e433019432b None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.549605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e3a83-f23c-4751-b39c-9e433019432b None admin] RBAC: Adding query filter params (name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:43.549902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e3a83-f23c-4751-b39c-9e433019432b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:43.551312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e3a83-f23c-4751-b39c-9e433019432b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:43.572163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 358/721] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:43.580772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e3a83-f23c-4751-b39c-9e433019432b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:43.607940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f092-adf6-45f3-9384-7f9aea91c019 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.621119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:43.646533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de8891-3de5-4cdc-934a-ef7a1b1d5dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:43.647566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de8891-3de5-4cdc-934a-ef7a1b1d5dca None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.648084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de8891-3de5-4cdc-934a-ef7a1b1d5dca None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.648566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de8891-3de5-4cdc-934a-ef7a1b1d5dca None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.649612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de8891-3de5-4cdc-934a-ef7a1b1d5dca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:43.650138 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de8891-3de5-4cdc-934a-ef7a1b1d5dca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:43.651811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de8891-3de5-4cdc-934a-ef7a1b1d5dca None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:43.671709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 364/722] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:43.673139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de8891-3de5-4cdc-934a-ef7a1b1d5dca None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:43.784264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de8891-3de5-4cdc-934a-ef7a1b1d5dca None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.823878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7447fc-eae7-4906-862d-8655840330e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:43.824858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7447fc-eae7-4906-862d-8655840330e6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.825357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7447fc-eae7-4906-862d-8655840330e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.826096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7447fc-eae7-4906-862d-8655840330e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.827594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7447fc-eae7-4906-862d-8655840330e6 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=98925192a33544e081f1a02faed60b7f) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:43.828328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7447fc-eae7-4906-862d-8655840330e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:43.830448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7447fc-eae7-4906-862d-8655840330e6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:43.837332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 365/723] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:43 2022] GET /identity/v3/role_assignments?user.id=98925192a33544e081f1a02faed60b7f&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=d6155b01aace49f887f29aa2861d31cf => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:43.885624 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bd811-f691-48cf-85c2-89c135d6889d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.886271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bd811-f691-48cf-85c2-89c135d6889d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.886753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bd811-f691-48cf-85c2-89c135d6889d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.888589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 366/724] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:43.895436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7347e3-0574-4918-b348-63b34dcc2770 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.895436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7347e3-0574-4918-b348-63b34dcc2770 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.895436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7347e3-0574-4918-b348-63b34dcc2770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.911145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:43.914784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-af7347e3-0574-4918-b348-63b34dcc2770 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:43.915977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-af7347e3-0574-4918-b348-63b34dcc2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:43.968849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e3a83-f23c-4751-b39c-9e433019432b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.994095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.026068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04981cae-997d-4d15-afe0-c0e00f9e476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.026726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04981cae-997d-4d15-afe0-c0e00f9e476d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.027001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04981cae-997d-4d15-afe0-c0e00f9e476d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.027272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04981cae-997d-4d15-afe0-c0e00f9e476d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.045726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04981cae-997d-4d15-afe0-c0e00f9e476d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.047746 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04981cae-997d-4d15-afe0-c0e00f9e476d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-04981cae-997d-4d15-afe0-c0e00f9e476d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:44.064258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:44.065387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:44.066340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:44.066340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:44.066340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:44.069448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 359/725] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:44.075210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04981cae-997d-4d15-afe0-c0e00f9e476d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.094478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 367/726] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:44.131612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7347e3-0574-4918-b348-63b34dcc2770 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.212092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04981cae-997d-4d15-afe0-c0e00f9e476d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.227425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.250632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f4a19-52e0-47aa-9b42-b7a7fa8b59bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.251605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f4a19-52e0-47aa-9b42-b7a7fa8b59bb None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.252092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f4a19-52e0-47aa-9b42-b7a7fa8b59bb None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.252610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f4a19-52e0-47aa-9b42-b7a7fa8b59bb None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.253646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f4a19-52e0-47aa-9b42-b7a7fa8b59bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:44.254287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f4a19-52e0-47aa-9b42-b7a7fa8b59bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.255858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f4a19-52e0-47aa-9b42-b7a7fa8b59bb None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.269812 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 360/727] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:44.276584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f4a19-52e0-47aa-9b42-b7a7fa8b59bb None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.334875 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7347e3-0574-4918-b348-63b34dcc2770 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.422784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929e84b-e2fc-4030-b714-5910d227f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.423434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929e84b-e2fc-4030-b714-5910d227f875 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.423968 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929e84b-e2fc-4030-b714-5910d227f875 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.424293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929e84b-e2fc-4030-b714-5910d227f875 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.438874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929e84b-e2fc-4030-b714-5910d227f875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-a929e84b-e2fc-4030-b714-5910d227f875 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:44.444127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:44.445109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:44.445972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:44.452712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 368/728] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:44.452712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929e84b-e2fc-4030-b714-5910d227f875 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.483486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.494732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f4a19-52e0-47aa-9b42-b7a7fa8b59bb None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.535970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0345d59-746c-4e3b-9959-a0e353716987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.537126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0345d59-746c-4e3b-9959-a0e353716987 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.537607 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0345d59-746c-4e3b-9959-a0e353716987 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.538103 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0345d59-746c-4e3b-9959-a0e353716987 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.547661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0345d59-746c-4e3b-9959-a0e353716987 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.549822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0345d59-746c-4e3b-9959-a0e353716987 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-a0345d59-746c-4e3b-9959-a0e353716987 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:44.564316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:44.565358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:44.566271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:44.566271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:44.566271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:44.566271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:44.566271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:44.566271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:44.566271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:44.566271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:44.566271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:09:44.566271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:44.566814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929e84b-e2fc-4030-b714-5910d227f875 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.570043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 361/729] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:44.577730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aae483-d05a-4de3-b1a2-33102770053d None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.578281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aae483-d05a-4de3-b1a2-33102770053d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.578827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aae483-d05a-4de3-b1a2-33102770053d None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.581771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 362/730] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:44.582712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aae483-d05a-4de3-b1a2-33102770053d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.606269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab0c16-2575-4a04-8681-e96d9fa68eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.606926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab0c16-2575-4a04-8681-e96d9fa68eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.607082 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab0c16-2575-4a04-8681-e96d9fa68eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.607360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab0c16-2575-4a04-8681-e96d9fa68eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.608594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab0c16-2575-4a04-8681-e96d9fa68eb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:44.608935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab0c16-2575-4a04-8681-e96d9fa68eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.614177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab0c16-2575-4a04-8681-e96d9fa68eb8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.624766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.628332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 369/731] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:44.630093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d6cc-af9c-4164-a15b-0e828e4cae07 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.630093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d6cc-af9c-4164-a15b-0e828e4cae07 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.630370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d6cc-af9c-4164-a15b-0e828e4cae07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.653699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9273d6cc-af9c-4164-a15b-0e828e4cae07 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:44.655471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9273d6cc-af9c-4164-a15b-0e828e4cae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:44.735375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aae483-d05a-4de3-b1a2-33102770053d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.744138 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 370/732] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:44.744920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273d6cc-af9c-4164-a15b-0e828e4cae07 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.767751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.787192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a9cc-1dfb-4436-8608-2becb7d74309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.788177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a9cc-1dfb-4436-8608-2becb7d74309 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.788749 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a9cc-1dfb-4436-8608-2becb7d74309 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.789354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a9cc-1dfb-4436-8608-2becb7d74309 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.790288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a9cc-1dfb-4436-8608-2becb7d74309 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:44.790788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a9cc-1dfb-4436-8608-2becb7d74309 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.792512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a9cc-1dfb-4436-8608-2becb7d74309 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.823619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 363/733] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:44.830881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a9cc-1dfb-4436-8608-2becb7d74309 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.872370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273d6cc-af9c-4164-a15b-0e828e4cae07 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.907841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a04d-89d9-415b-aa11-a1467fa3844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.908517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a04d-89d9-415b-aa11-a1467fa3844a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.908757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a04d-89d9-415b-aa11-a1467fa3844a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.909076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a04d-89d9-415b-aa11-a1467fa3844a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.919522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6a04d-89d9-415b-aa11-a1467fa3844a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.921906 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6a04d-89d9-415b-aa11-a1467fa3844a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-aea6a04d-89d9-415b-aa11-a1467fa3844a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:44.941478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:44.942543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:44.944296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:44.944296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:44.944296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:44.945046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.949912 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 371/734] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:44.951786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a04d-89d9-415b-aa11-a1467fa3844a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.970534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a9cc-1dfb-4436-8608-2becb7d74309 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.010663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930a14d-62ab-4786-955d-0759736607d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.011522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930a14d-62ab-4786-955d-0759736607d7 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.011933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930a14d-62ab-4786-955d-0759736607d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.012333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930a14d-62ab-4786-955d-0759736607d7 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.013315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930a14d-62ab-4786-955d-0759736607d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.015522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930a14d-62ab-4786-955d-0759736607d7 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.036056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.038679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 364/735] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:09:44 2022] POST /identity/v3/services => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:45.040077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930a14d-62ab-4786-955d-0759736607d7 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.084078 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a04d-89d9-415b-aa11-a1467fa3844a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.145740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9d387-e3e6-400d-b701-7142581e11d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.146457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9d387-e3e6-400d-b701-7142581e11d5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.146838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9d387-e3e6-400d-b701-7142581e11d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.147268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9d387-e3e6-400d-b701-7142581e11d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.182093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930a14d-62ab-4786-955d-0759736607d7 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.232460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8b47-f4e4-4789-9834-0f6d69b5d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.234038 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8b47-f4e4-4789-9834-0f6d69b5d984 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.234469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8b47-f4e4-4789-9834-0f6d69b5d984 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.235001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8b47-f4e4-4789-9834-0f6d69b5d984 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.236310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8b47-f4e4-4789-9834-0f6d69b5d984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:45.236897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8b47-f4e4-4789-9834-0f6d69b5d984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.238632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8b47-f4e4-4789-9834-0f6d69b5d984 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.247265 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9d387-e3e6-400d-b701-7142581e11d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.249021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9d387-e3e6-400d-b701-7142581e11d5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.259120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 365/736] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:45.276516 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8b47-f4e4-4789-9834-0f6d69b5d984 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.291590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.350750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.393808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8b47-f4e4-4789-9834-0f6d69b5d984 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.394653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 372/737] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:45.400947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9d387-e3e6-400d-b701-7142581e11d5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.438466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb3474-d974-4ae2-bc09-4ab4dcd3c5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.439266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb3474-d974-4ae2-bc09-4ab4dcd3c5dc None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.439690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb3474-d974-4ae2-bc09-4ab4dcd3c5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.440063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb3474-d974-4ae2-bc09-4ab4dcd3c5dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.447994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb3474-d974-4ae2-bc09-4ab4dcd3c5dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.449623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb3474-d974-4ae2-bc09-4ab4dcd3c5dc None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-0beb3474-d974-4ae2-bc09-4ab4dcd3c5dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:45.462407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:45.463393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:45.464324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 366/738] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:45.466590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9f7dd-379d-45d1-b421-8ab587137b5d None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.466590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9f7dd-379d-45d1-b421-8ab587137b5d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.466590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9f7dd-379d-45d1-b421-8ab587137b5d None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.472715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 367/739] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:45.472715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9f7dd-379d-45d1-b421-8ab587137b5d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.523269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9d387-e3e6-400d-b701-7142581e11d5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.553705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.574222 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2882ba-4422-4cf7-a09a-b8c2e08d95e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.575248 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2882ba-4422-4cf7-a09a-b8c2e08d95e3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.575743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2882ba-4422-4cf7-a09a-b8c2e08d95e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.576835 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2882ba-4422-4cf7-a09a-b8c2e08d95e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.588376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2882ba-4422-4cf7-a09a-b8c2e08d95e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.590324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2882ba-4422-4cf7-a09a-b8c2e08d95e3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.597073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9f7dd-379d-45d1-b421-8ab587137b5d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3b2882ba-4422-4cf7-a09a-b8c2e08d95e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:45.606630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:45.607631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:45.608532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:45.608532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:45.608532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:45.611535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 373/740] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:45.617599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ae8f0-63bc-4822-9589-eeccf16da979 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.618157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ae8f0-63bc-4822-9589-eeccf16da979 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.618673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ae8f0-63bc-4822-9589-eeccf16da979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.633828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fe7f8-fb89-4b9f-af35-93d1514068f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.634508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fe7f8-fb89-4b9f-af35-93d1514068f7 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.634781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fe7f8-fb89-4b9f-af35-93d1514068f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.635050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fe7f8-fb89-4b9f-af35-93d1514068f7 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.635864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fe7f8-fb89-4b9f-af35-93d1514068f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:45.636238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fe7f8-fb89-4b9f-af35-93d1514068f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.637712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fe7f8-fb89-4b9f-af35-93d1514068f7 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.640964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b96ae8f0-63bc-4822-9589-eeccf16da979 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:45.642446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b96ae8f0-63bc-4822-9589-eeccf16da979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:45.654827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.656942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 368/741] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:45.657888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fe7f8-fb89-4b9f-af35-93d1514068f7 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.718635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 374/742] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:45.719892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ae8f0-63bc-4822-9589-eeccf16da979 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.789845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fe7f8-fb89-4b9f-af35-93d1514068f7 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.814772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.827615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ae8f0-63bc-4822-9589-eeccf16da979 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.829561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf5bca-36a1-4237-895c-afb03b42bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.830333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf5bca-36a1-4237-895c-afb03b42bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.830743 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf5bca-36a1-4237-895c-afb03b42bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.831219 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf5bca-36a1-4237-895c-afb03b42bbcf None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.832036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf5bca-36a1-4237-895c-afb03b42bbcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:45.832514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf5bca-36a1-4237-895c-afb03b42bbcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.834074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf5bca-36a1-4237-895c-afb03b42bbcf None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.852986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 369/743] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:45.854186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf5bca-36a1-4237-895c-afb03b42bbcf None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.865166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0cd5-6c76-4f34-988a-9aca3c976ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.866126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0cd5-6c76-4f34-988a-9aca3c976ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.866126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0cd5-6c76-4f34-988a-9aca3c976ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.866476 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0cd5-6c76-4f34-988a-9aca3c976ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.883185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.941916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a0cd5-6c76-4f34-988a-9aca3c976ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.943457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a0cd5-6c76-4f34-988a-9aca3c976ac3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.963816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf5bca-36a1-4237-895c-afb03b42bbcf None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.001101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606c2e9-7fb6-4dac-a292-0ff891ca3e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.002090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606c2e9-7fb6-4dac-a292-0ff891ca3e7b None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.002569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606c2e9-7fb6-4dac-a292-0ff891ca3e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.003039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606c2e9-7fb6-4dac-a292-0ff891ca3e7b None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.003906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606c2e9-7fb6-4dac-a292-0ff891ca3e7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.005500 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606c2e9-7fb6-4dac-a292-0ff891ca3e7b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.025055 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 370/744] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:09:45 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:46.026256 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606c2e9-7fb6-4dac-a292-0ff891ca3e7b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.054210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 375/745] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:46.062287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0cd5-6c76-4f34-988a-9aca3c976ac3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.094919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.168069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.174661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606c2e9-7fb6-4dac-a292-0ff891ca3e7b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.215250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbeaba-0ea0-4a0c-8472-9895a74f7692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.216243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbeaba-0ea0-4a0c-8472-9895a74f7692 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.216757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbeaba-0ea0-4a0c-8472-9895a74f7692 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.218035 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbeaba-0ea0-4a0c-8472-9895a74f7692 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.226707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbeaba-0ea0-4a0c-8472-9895a74f7692 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.228500 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbeaba-0ea0-4a0c-8472-9895a74f7692 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-c1fbeaba-0ea0-4a0c-8472-9895a74f7692 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:46.241163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:46.242112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:46.243000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:46.243000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:46.243000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:46.243000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:46.243000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:46.243000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:46.243000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:46.243000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:46.245108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 371/746] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:46.251164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf7a29-0a1c-4dd3-a857-da732b9c79a7 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.251725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf7a29-0a1c-4dd3-a857-da732b9c79a7 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.252151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf7a29-0a1c-4dd3-a857-da732b9c79a7 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.254184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 372/747] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:46.255100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf7a29-0a1c-4dd3-a857-da732b9c79a7 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.285069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0cd5-6c76-4f34-988a-9aca3c976ac3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.323804 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226742f5-e2a6-4f37-86ea-4baf1efcc025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.324442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226742f5-e2a6-4f37-86ea-4baf1efcc025 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.324756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226742f5-e2a6-4f37-86ea-4baf1efcc025 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.325031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226742f5-e2a6-4f37-86ea-4baf1efcc025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.339043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226742f5-e2a6-4f37-86ea-4baf1efcc025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.340729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226742f5-e2a6-4f37-86ea-4baf1efcc025 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-226742f5-e2a6-4f37-86ea-4baf1efcc025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:46.361201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:46.362212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:46.363939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:46.363939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:46.363939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:46.367454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 376/748] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:46.369037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16f66e-6fd6-44af-8aaa-ecf90a05bbb8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.369325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16f66e-6fd6-44af-8aaa-ecf90a05bbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.369596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16f66e-6fd6-44af-8aaa-ecf90a05bbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.382884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf7a29-0a1c-4dd3-a857-da732b9c79a7 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.392416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1f16f66e-6fd6-44af-8aaa-ecf90a05bbb8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:46.393658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1f16f66e-6fd6-44af-8aaa-ecf90a05bbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:46.401103 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.429336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ba7d5-a3c6-49cf-b304-303a372003ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.430354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ba7d5-a3c6-49cf-b304-303a372003ed None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.430901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ba7d5-a3c6-49cf-b304-303a372003ed None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.431380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ba7d5-a3c6-49cf-b304-303a372003ed None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.432279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ba7d5-a3c6-49cf-b304-303a372003ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:46.432811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ba7d5-a3c6-49cf-b304-303a372003ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.434767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ba7d5-a3c6-49cf-b304-303a372003ed None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.449031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 373/749] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:46.450442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ba7d5-a3c6-49cf-b304-303a372003ed None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.484743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 377/750] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:46.484743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16f66e-6fd6-44af-8aaa-ecf90a05bbb8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.513871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.580308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ba7d5-a3c6-49cf-b304-303a372003ed None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.609042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16f66e-6fd6-44af-8aaa-ecf90a05bbb8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.624490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce75f9-c50d-4646-9c2a-11fe3959edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.625148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce75f9-c50d-4646-9c2a-11fe3959edfd None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.625520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce75f9-c50d-4646-9c2a-11fe3959edfd None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.625795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce75f9-c50d-4646-9c2a-11fe3959edfd None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.626439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce75f9-c50d-4646-9c2a-11fe3959edfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:46.626742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce75f9-c50d-4646-9c2a-11fe3959edfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.628108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce75f9-c50d-4646-9c2a-11fe3959edfd None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.641069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 374/751] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:46.641897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce75f9-c50d-4646-9c2a-11fe3959edfd None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.662920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.664191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3c14e-429e-4199-bb7d-5cf2b6ceeb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.665074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3c14e-429e-4199-bb7d-5cf2b6ceeb5d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.665557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3c14e-429e-4199-bb7d-5cf2b6ceeb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.666762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3c14e-429e-4199-bb7d-5cf2b6ceeb5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.667763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3c14e-429e-4199-bb7d-5cf2b6ceeb5d None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=6c806e8c13414c38ad398069bfa2f03b) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:46.668523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3c14e-429e-4199-bb7d-5cf2b6ceeb5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.670954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3c14e-429e-4199-bb7d-5cf2b6ceeb5d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.679951 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 378/752] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/role_assignments?user.id=6c806e8c13414c38ad398069bfa2f03b&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:46.681251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3c14e-429e-4199-bb7d-5cf2b6ceeb5d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.834265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce75f9-c50d-4646-9c2a-11fe3959edfd None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.847062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.861965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3c14e-429e-4199-bb7d-5cf2b6ceeb5d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.896445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a8075-ac1e-4e26-83f2-8e87e8725be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.897702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a8075-ac1e-4e26-83f2-8e87e8725be5 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.898260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a8075-ac1e-4e26-83f2-8e87e8725be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.898736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a8075-ac1e-4e26-83f2-8e87e8725be5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.910999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4212-e32d-497b-8d23-184aa30fa756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.911708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4212-e32d-497b-8d23-184aa30fa756 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.912345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4212-e32d-497b-8d23-184aa30fa756 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.912718 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4212-e32d-497b-8d23-184aa30fa756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.913046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a8075-ac1e-4e26-83f2-8e87e8725be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-404a8075-ac1e-4e26-83f2-8e87e8725be5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:46.926082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:46.927429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:46.928272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:46.928951 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f4212-e32d-497b-8d23-184aa30fa756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.928951 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f4212-e32d-497b-8d23-184aa30fa756 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.929078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 375/753] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:46.933402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a8075-ac1e-4e26-83f2-8e87e8725be5 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-694f4212-e32d-497b-8d23-184aa30fa756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:46.958554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:46.959485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:46.961515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:46.961515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:46.961515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:46.961515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:46.961515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:46.961515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:46.961515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:46.961515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:46.964299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 379/754] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:46.965776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4212-e32d-497b-8d23-184aa30fa756 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.088083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4212-e32d-497b-8d23-184aa30fa756 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.127220 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531002e3-5a0a-4a15-91e5-19f5e71dbe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.127828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531002e3-5a0a-4a15-91e5-19f5e71dbe74 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.128104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531002e3-5a0a-4a15-91e5-19f5e71dbe74 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.128373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531002e3-5a0a-4a15-91e5-19f5e71dbe74 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.129088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531002e3-5a0a-4a15-91e5-19f5e71dbe74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:47.129389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531002e3-5a0a-4a15-91e5-19f5e71dbe74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.130973 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531002e3-5a0a-4a15-91e5-19f5e71dbe74 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.144810 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 380/755] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:47.150081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.155504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531002e3-5a0a-4a15-91e5-19f5e71dbe74 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.180980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.194689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a8075-ac1e-4e26-83f2-8e87e8725be5 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.250453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fce6e-2365-449a-ba95-f23c6fc21b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.251070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fce6e-2365-449a-ba95-f23c6fc21b6a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.251349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fce6e-2365-449a-ba95-f23c6fc21b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.251621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fce6e-2365-449a-ba95-f23c6fc21b6a None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.252285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fce6e-2365-449a-ba95-f23c6fc21b6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:47.252589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fce6e-2365-449a-ba95-f23c6fc21b6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.253982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fce6e-2365-449a-ba95-f23c6fc21b6a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.273423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 376/756] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:47.280386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fce6e-2365-449a-ba95-f23c6fc21b6a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.347609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531002e3-5a0a-4a15-91e5-19f5e71dbe74 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.385685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fce6e-2365-449a-ba95-f23c6fc21b6a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.422649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ad011-e9e1-449c-82ad-df3919534bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.423830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ad011-e9e1-449c-82ad-df3919534bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.424363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ad011-e9e1-449c-82ad-df3919534bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.424938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ad011-e9e1-449c-82ad-df3919534bd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.425879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ad011-e9e1-449c-82ad-df3919534bd7 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=20f9b96629544596a8d9b81cce57af21) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:47.426414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ad011-e9e1-449c-82ad-df3919534bd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.426705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622e38-0e2a-4c31-aa49-8c41faab2858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.427338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622e38-0e2a-4c31-aa49-8c41faab2858 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.427617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622e38-0e2a-4c31-aa49-8c41faab2858 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.427887 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622e38-0e2a-4c31-aa49-8c41faab2858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.428962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ad011-e9e1-449c-82ad-df3919534bd7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.436811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 381/757] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/role_assignments?user.id=20f9b96629544596a8d9b81cce57af21&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=d6155b01aace49f887f29aa2861d31cf => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:47.438405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ab9bf-ae08-4118-8115-e4f3d3b25eee None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.438907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ab9bf-ae08-4118-8115-e4f3d3b25eee None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.439385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ab9bf-ae08-4118-8115-e4f3d3b25eee None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.441237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 382/758] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:47.443078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.448663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb192-774c-4938-a4f6-f6082a5ce418 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.448663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb192-774c-4938-a4f6-f6082a5ce418 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.448663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb192-774c-4938-a4f6-f6082a5ce418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.454179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef622e38-0e2a-4c31-aa49-8c41faab2858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.455707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef622e38-0e2a-4c31-aa49-8c41faab2858 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.487168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b3afb192-774c-4938-a4f6-f6082a5ce418 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:47.488405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b3afb192-774c-4938-a4f6-f6082a5ce418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-ef622e38-0e2a-4c31-aa49-8c41faab2858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:47.491598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:47.492571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:47.494127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:47.494127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:47.494127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:47.494127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 377/759] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:47.499625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622e38-0e2a-4c31-aa49-8c41faab2858 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.618724 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 383/760] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:47.641913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb192-774c-4938-a4f6-f6082a5ce418 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.650390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.683664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622e38-0e2a-4c31-aa49-8c41faab2858 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.769296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb192-774c-4938-a4f6-f6082a5ce418 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.772855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e05289-1b4e-46fc-b153-9763de543b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.773462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e05289-1b4e-46fc-b153-9763de543b79 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.773741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e05289-1b4e-46fc-b153-9763de543b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.774013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e05289-1b4e-46fc-b153-9763de543b79 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.774652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e05289-1b4e-46fc-b153-9763de543b79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:47.774951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e05289-1b4e-46fc-b153-9763de543b79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.776331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e05289-1b4e-46fc-b153-9763de543b79 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.801515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 378/761] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:47.807533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e05289-1b4e-46fc-b153-9763de543b79 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.865372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b2b5-8c1d-4f12-9a6a-cfbbd3fc9cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.866296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b2b5-8c1d-4f12-9a6a-cfbbd3fc9cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.866733 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b2b5-8c1d-4f12-9a6a-cfbbd3fc9cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.867158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b2b5-8c1d-4f12-9a6a-cfbbd3fc9cc8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.867879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b2b5-8c1d-4f12-9a6a-cfbbd3fc9cc8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.869455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b2b5-8c1d-4f12-9a6a-cfbbd3fc9cc8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.876997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-6779b2b5-8c1d-4f12-9a6a-cfbbd3fc9cc8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:47.891190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:47.892228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:09:47.893102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:47.903040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 384/762] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:47.911087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b2b5-8c1d-4f12-9a6a-cfbbd3fc9cc8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.946141 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e05289-1b4e-46fc-b153-9763de543b79 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.003076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad8014-2fe8-4da9-a159-8641e4153c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.003707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad8014-2fe8-4da9-a159-8641e4153c2b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.003980 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad8014-2fe8-4da9-a159-8641e4153c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.004245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad8014-2fe8-4da9-a159-8641e4153c2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.017806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad8014-2fe8-4da9-a159-8641e4153c2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.019266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad8014-2fe8-4da9-a159-8641e4153c2b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-2aad8014-2fe8-4da9-a159-8641e4153c2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:48.045185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:48.046185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:48.047110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 379/763] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:48.051485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:48.052654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad8014-2fe8-4da9-a159-8641e4153c2b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.110777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b2b5-8c1d-4f12-9a6a-cfbbd3fc9cc8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.183916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad8014-2fe8-4da9-a159-8641e4153c2b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.193910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9bbe0-9d8e-4b64-a153-bc57bc4bd4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.194863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9bbe0-9d8e-4b64-a153-bc57bc4bd4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.195368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9bbe0-9d8e-4b64-a153-bc57bc4bd4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.195856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9bbe0-9d8e-4b64-a153-bc57bc4bd4b4 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.196697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9bbe0-9d8e-4b64-a153-bc57bc4bd4b4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:48.197194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9bbe0-9d8e-4b64-a153-bc57bc4bd4b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.198007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:48.198831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9bbe0-9d8e-4b64-a153-bc57bc4bd4b4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.212448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 385/764] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:48.216745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9bbe0-9d8e-4b64-a153-bc57bc4bd4b4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.238255 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2784a4-49d8-4bbe-848d-50b0884260ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.239263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2784a4-49d8-4bbe-848d-50b0884260ce None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.239777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2784a4-49d8-4bbe-848d-50b0884260ce None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.240238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2784a4-49d8-4bbe-848d-50b0884260ce None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.241263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2784a4-49d8-4bbe-848d-50b0884260ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:48.241949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2784a4-49d8-4bbe-848d-50b0884260ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.244512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2784a4-49d8-4bbe-848d-50b0884260ce None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.278907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 380/765] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.287402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2784a4-49d8-4bbe-848d-50b0884260ce None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.405874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9bbe0-9d8e-4b64-a153-bc57bc4bd4b4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.472772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2784a4-49d8-4bbe-848d-50b0884260ce None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.477902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4821-54da-40c1-8da1-049ec4c0dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.478518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4821-54da-40c1-8da1-049ec4c0dc0e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.478786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4821-54da-40c1-8da1-049ec4c0dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.479050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4821-54da-40c1-8da1-049ec4c0dc0e None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.480596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4821-54da-40c1-8da1-049ec4c0dc0e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:48.480957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4821-54da-40c1-8da1-049ec4c0dc0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.482311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4821-54da-40c1-8da1-049ec4c0dc0e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.488235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:48.495538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 386/766] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.501308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4821-54da-40c1-8da1-049ec4c0dc0e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.535574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa22489-c77a-4fe9-b4b0-abad767b3dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.536241 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa22489-c77a-4fe9-b4b0-abad767b3dba None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.536517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa22489-c77a-4fe9-b4b0-abad767b3dba None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.537650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa22489-c77a-4fe9-b4b0-abad767b3dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.550999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa22489-c77a-4fe9-b4b0-abad767b3dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.550999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa22489-c77a-4fe9-b4b0-abad767b3dba None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-caa22489-c77a-4fe9-b4b0-abad767b3dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:48.567318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:48.568371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:48.569291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:48.569291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:48.569291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:48.569291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 381/767] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:48.575925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa22489-c77a-4fe9-b4b0-abad767b3dba None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.617111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:48.671101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4821-54da-40c1-8da1-049ec4c0dc0e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.715565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa22489-c77a-4fe9-b4b0-abad767b3dba None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.718117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6768f1b-9cad-4c39-8cec-a26d7ede6968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.719732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6768f1b-9cad-4c39-8cec-a26d7ede6968 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.720007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6768f1b-9cad-4c39-8cec-a26d7ede6968 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.720273 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6768f1b-9cad-4c39-8cec-a26d7ede6968 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.721019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6768f1b-9cad-4c39-8cec-a26d7ede6968 None admin] RBAC: Adding query filter params (interface=public, service_id=9cf98e49b4f54c44a4eebf0dce8ad76d, region_id=RegionOne) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:48.721382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6768f1b-9cad-4c39-8cec-a26d7ede6968 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.722976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6768f1b-9cad-4c39-8cec-a26d7ede6968 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.734350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 387/768] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/endpoints?service_id=9cf98e49b4f54c44a4eebf0dce8ad76d&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.735852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f58b-71f3-4f8e-8e0d-5bfc81162b3b None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.736131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f58b-71f3-4f8e-8e0d-5bfc81162b3b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.736404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26f58b-71f3-4f8e-8e0d-5bfc81162b3b None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.738224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 388/769] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:48.745936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b72c85-cb5c-4182-b83b-258b820849a3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.746431 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b72c85-cb5c-4182-b83b-258b820849a3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.746867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b72c85-cb5c-4182-b83b-258b820849a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.758340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7a3a2-2f16-4157-8af6-3fb69cbb1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.758945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a3a2-2f16-4157-8af6-3fb69cbb1ccd None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.759227 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a3a2-2f16-4157-8af6-3fb69cbb1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.759496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a3a2-2f16-4157-8af6-3fb69cbb1ccd None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.760133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7a3a2-2f16-4157-8af6-3fb69cbb1ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:48.760432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7a3a2-2f16-4157-8af6-3fb69cbb1ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.761830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7a3a2-2f16-4157-8af6-3fb69cbb1ccd None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.767782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-81b72c85-cb5c-4182-b83b-258b820849a3 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:48.769212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-81b72c85-cb5c-4182-b83b-258b820849a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:48.775049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 382/770] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.775892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7a3a2-2f16-4157-8af6-3fb69cbb1ccd None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.844700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:48.866537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 389/771] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:48.867423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b72c85-cb5c-4182-b83b-258b820849a3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.877910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:48.901233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7a3a2-2f16-4157-8af6-3fb69cbb1ccd None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.945646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16a7d-eba7-4c52-b89c-f1912b8ebe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.946234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16a7d-eba7-4c52-b89c-f1912b8ebe70 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.946513 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16a7d-eba7-4c52-b89c-f1912b8ebe70 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.946780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16a7d-eba7-4c52-b89c-f1912b8ebe70 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.947467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f16a7d-eba7-4c52-b89c-f1912b8ebe70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.948863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f16a7d-eba7-4c52-b89c-f1912b8ebe70 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.954312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 383/772] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.954938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16a7d-eba7-4c52-b89c-f1912b8ebe70 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.005830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b72c85-cb5c-4182-b83b-258b820849a3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.062053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beca45-807a-45bf-9af6-280cc19383f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.063934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beca45-807a-45bf-9af6-280cc19383f3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.064460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beca45-807a-45bf-9af6-280cc19383f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.065230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beca45-807a-45bf-9af6-280cc19383f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.068822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16a7d-eba7-4c52-b89c-f1912b8ebe70 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.075844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beca45-807a-45bf-9af6-280cc19383f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.079287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beca45-807a-45bf-9af6-280cc19383f3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-85beca45-807a-45bf-9af6-280cc19383f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:49.097365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:49.098337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:49.099281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:49.099281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:49.099281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:49.099281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:49.099281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:49.099281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:49.099281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:49.099281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:49.106560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 390/773] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:49.106560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831310e2-5751-4284-adf2-5669cd370e3e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.106560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831310e2-5751-4284-adf2-5669cd370e3e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.106827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831310e2-5751-4284-adf2-5669cd370e3e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.108864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 391/774] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:49.109373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831310e2-5751-4284-adf2-5669cd370e3e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.119891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e2f29-84db-4a22-ad5b-49ba7c29e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.120671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2f29-84db-4a22-ad5b-49ba7c29e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.120892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2f29-84db-4a22-ad5b-49ba7c29e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.121160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2f29-84db-4a22-ad5b-49ba7c29e3a7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.121740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e2f29-84db-4a22-ad5b-49ba7c29e3a7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.123797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e2f29-84db-4a22-ad5b-49ba7c29e3a7 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-076e2f29-84db-4a22-ad5b-49ba7c29e3a7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:49.135760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:49.136824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:49.137656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 384/775] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:49.138453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732bbd9-5ec2-4585-940d-351122ac5cfc None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.139759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732bbd9-5ec2-4585-940d-351122ac5cfc None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.139759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732bbd9-5ec2-4585-940d-351122ac5cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.163887 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-7732bbd9-5ec2-4585-940d-351122ac5cfc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:49.165110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-7732bbd9-5ec2-4585-940d-351122ac5cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:49.169134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.192684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.255333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831310e2-5751-4284-adf2-5669cd370e3e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.266995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 385/776] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:49.269243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732bbd9-5ec2-4585-940d-351122ac5cfc None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.313695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27780ecf-ce0c-4c1e-9118-9b093511a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.314925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27780ecf-ce0c-4c1e-9118-9b093511a356 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.316306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27780ecf-ce0c-4c1e-9118-9b093511a356 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.316853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27780ecf-ce0c-4c1e-9118-9b093511a356 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.317777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27780ecf-ce0c-4c1e-9118-9b093511a356 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:49.318304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27780ecf-ce0c-4c1e-9118-9b093511a356 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.319964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27780ecf-ce0c-4c1e-9118-9b093511a356 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.343750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 392/777] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:49.343750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27780ecf-ce0c-4c1e-9118-9b093511a356 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.413704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732bbd9-5ec2-4585-940d-351122ac5cfc None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.453030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27780ecf-ce0c-4c1e-9118-9b093511a356 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.467092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61b523-6fac-4bc8-9f82-95891ef6eaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.467702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b523-6fac-4bc8-9f82-95891ef6eaad None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.467974 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b523-6fac-4bc8-9f82-95891ef6eaad None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.468240 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b523-6fac-4bc8-9f82-95891ef6eaad None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.468891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61b523-6fac-4bc8-9f82-95891ef6eaad None admin] RBAC: Adding query filter params (name=network) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:49.469188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61b523-6fac-4bc8-9f82-95891ef6eaad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.470553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61b523-6fac-4bc8-9f82-95891ef6eaad None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.470983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.480364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 386/778] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:49.480364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61b523-6fac-4bc8-9f82-95891ef6eaad None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.505097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b406c-9199-411b-ba6b-bfe1d34aca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.505885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b406c-9199-411b-ba6b-bfe1d34aca11 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.506293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b406c-9199-411b-ba6b-bfe1d34aca11 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.506664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b406c-9199-411b-ba6b-bfe1d34aca11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.510958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.519197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b406c-9199-411b-ba6b-bfe1d34aca11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f15b406c-9199-411b-ba6b-bfe1d34aca11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:49.524382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:49.525480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:49.526300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:49.531052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 393/779] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:49.532039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b406c-9199-411b-ba6b-bfe1d34aca11 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.605839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61b523-6fac-4bc8-9f82-95891ef6eaad None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.643509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2a395-eb48-4d67-b4fb-9e73c7cd8363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.644497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a395-eb48-4d67-b4fb-9e73c7cd8363 None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.645062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a395-eb48-4d67-b4fb-9e73c7cd8363 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.645375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b406c-9199-411b-ba6b-bfe1d34aca11 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.645728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a395-eb48-4d67-b4fb-9e73c7cd8363 None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/98925192a33544e081f1a02faed60b7f/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.647987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2a395-eb48-4d67-b4fb-9e73c7cd8363 None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=98925192a33544e081f1a02faed60b7f, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.649697 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2a395-eb48-4d67-b4fb-9e73c7cd8363 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.664933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 387/780] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:49 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/98925192a33544e081f1a02faed60b7f/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:49.666116 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2a395-eb48-4d67-b4fb-9e73c7cd8363 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.689365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4b5e9-0683-4fa9-832f-4f9e84efb9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.690301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4b5e9-0683-4fa9-832f-4f9e84efb9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.690585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4b5e9-0683-4fa9-832f-4f9e84efb9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.690855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4b5e9-0683-4fa9-832f-4f9e84efb9e2 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.691509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4b5e9-0683-4fa9-832f-4f9e84efb9e2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:49.691839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4b5e9-0683-4fa9-832f-4f9e84efb9e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.693888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4b5e9-0683-4fa9-832f-4f9e84efb9e2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.707345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 394/781] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:49.707345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce46075-82c9-45a2-8da7-bea6bbbb6488 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.707345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce46075-82c9-45a2-8da7-bea6bbbb6488 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.707345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce46075-82c9-45a2-8da7-bea6bbbb6488 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.707345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 395/782] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:49.708280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce46075-82c9-45a2-8da7-bea6bbbb6488 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.753760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.758536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.803698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2a395-eb48-4d67-b4fb-9e73c7cd8363 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.844079 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3c4c9-e2c5-469b-921d-0e79965cd916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.844701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce46075-82c9-45a2-8da7-bea6bbbb6488 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.844949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3c4c9-e2c5-469b-921d-0e79965cd916 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.846447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3c4c9-e2c5-469b-921d-0e79965cd916 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.846447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3c4c9-e2c5-469b-921d-0e79965cd916 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.846447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3c4c9-e2c5-469b-921d-0e79965cd916 None admin] RBAC: Adding query filter params (name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:49.846670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3c4c9-e2c5-469b-921d-0e79965cd916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.848600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3c4c9-e2c5-469b-921d-0e79965cd916 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.858691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 388/783] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:49.860124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2456-a7e2-481d-b083-f36378aa9a0a None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.860409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2456-a7e2-481d-b083-f36378aa9a0a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.860723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2456-a7e2-481d-b083-f36378aa9a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.882637 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-1fdb2456-a7e2-481d-b083-f36378aa9a0a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:49.883817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1fdb2456-a7e2-481d-b083-f36378aa9a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:49.894483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a661d-1996-49e1-a011-7f1e07e1aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.895417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a661d-1996-49e1-a011-7f1e07e1aab0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.896185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a661d-1996-49e1-a011-7f1e07e1aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.896851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a661d-1996-49e1-a011-7f1e07e1aab0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.897766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a661d-1996-49e1-a011-7f1e07e1aab0 None admin] RBAC: Adding query filter params (interface=public, service_id=0e0afa828c1b46009e0aada15813ffad, region_id=RegionOne) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:49.898314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a661d-1996-49e1-a011-7f1e07e1aab0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.899935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a661d-1996-49e1-a011-7f1e07e1aab0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.906283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 396/784] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/endpoints?service_id=0e0afa828c1b46009e0aada15813ffad&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:49.907380 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a661d-1996-49e1-a011-7f1e07e1aab0 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.973916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 389/785] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:49.975105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2456-a7e2-481d-b083-f36378aa9a0a None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.026912 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.031392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a661d-1996-49e1-a011-7f1e07e1aab0 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.059698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.070215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79552bf-5768-4dcf-9e24-f60f4236bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.071210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79552bf-5768-4dcf-9e24-f60f4236bada None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.071687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79552bf-5768-4dcf-9e24-f60f4236bada None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.072152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79552bf-5768-4dcf-9e24-f60f4236bada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.084883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79552bf-5768-4dcf-9e24-f60f4236bada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.086743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79552bf-5768-4dcf-9e24-f60f4236bada None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f79552bf-5768-4dcf-9e24-f60f4236bada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:50.103694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:50.104714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:50.105605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:50.105605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:50.105605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:50.108505 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 397/786] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:50.113969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79552bf-5768-4dcf-9e24-f60f4236bada None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.114128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2456-a7e2-481d-b083-f36378aa9a0a None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.149445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baaa10-2821-48f1-ac34-81e8928c7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.150190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baaa10-2821-48f1-ac34-81e8928c7de4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.150415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baaa10-2821-48f1-ac34-81e8928c7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.150690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baaa10-2821-48f1-ac34-81e8928c7de4 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.151297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17baaa10-2821-48f1-ac34-81e8928c7de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.152677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17baaa10-2821-48f1-ac34-81e8928c7de4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.159198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 390/787] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:50.160054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baaa10-2821-48f1-ac34-81e8928c7de4 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.229133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79552bf-5768-4dcf-9e24-f60f4236bada None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.267905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66e88-4133-40b8-8d1b-060cf6f20bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.268943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66e88-4133-40b8-8d1b-060cf6f20bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.269430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66e88-4133-40b8-8d1b-060cf6f20bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.269915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66e88-4133-40b8-8d1b-060cf6f20bb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.278531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baaa10-2821-48f1-ac34-81e8928c7de4 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.282388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae66e88-4133-40b8-8d1b-060cf6f20bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-0ae66e88-4133-40b8-8d1b-060cf6f20bb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:50.288107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:50.289313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:50.290156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:50.292968 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 398/788] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:50.300743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66e88-4133-40b8-8d1b-060cf6f20bb5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.307515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.321001 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.325459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed92e9b-1eaa-495c-960d-912295591e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.325995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed92e9b-1eaa-495c-960d-912295591e84 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.326496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed92e9b-1eaa-495c-960d-912295591e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.326774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed92e9b-1eaa-495c-960d-912295591e84 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.328187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed92e9b-1eaa-495c-960d-912295591e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:50.328494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed92e9b-1eaa-495c-960d-912295591e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.329974 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed92e9b-1eaa-495c-960d-912295591e84 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.343989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 391/789] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:50.354494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed92e9b-1eaa-495c-960d-912295591e84 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.426649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66e88-4133-40b8-8d1b-060cf6f20bb5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.464268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd4d2b-f50f-4e0c-9e63-dc422e442a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.465305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd4d2b-f50f-4e0c-9e63-dc422e442a82 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.465840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd4d2b-f50f-4e0c-9e63-dc422e442a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.466426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd4d2b-f50f-4e0c-9e63-dc422e442a82 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.467837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd4d2b-f50f-4e0c-9e63-dc422e442a82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:50.468341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd4d2b-f50f-4e0c-9e63-dc422e442a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.470195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd4d2b-f50f-4e0c-9e63-dc422e442a82 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.477001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed92e9b-1eaa-495c-960d-912295591e84 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.480484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 399/790] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:50.492788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd4d2b-f50f-4e0c-9e63-dc422e442a82 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.521762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21681899-3c9f-4c83-b405-0942f7fcf079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.522403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21681899-3c9f-4c83-b405-0942f7fcf079 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.522683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21681899-3c9f-4c83-b405-0942f7fcf079 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.522953 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21681899-3c9f-4c83-b405-0942f7fcf079 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.533778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21681899-3c9f-4c83-b405-0942f7fcf079 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.535491 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21681899-3c9f-4c83-b405-0942f7fcf079 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-21681899-3c9f-4c83-b405-0942f7fcf079 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:50.548762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:50.549739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:50.550698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:50.550698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:50.550698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:50.550698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:50.550698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:50.550698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:50.550698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:50.550698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:50.550698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:09:50.550698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:50.553509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 392/791] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:50.559221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21681899-3c9f-4c83-b405-0942f7fcf079 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.590868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.616860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.622521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd4d2b-f50f-4e0c-9e63-dc422e442a82 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.668808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893b7ae-c716-4873-be02-1c40da92d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.669483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893b7ae-c716-4873-be02-1c40da92d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.669759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893b7ae-c716-4873-be02-1c40da92d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.670574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893b7ae-c716-4873-be02-1c40da92d0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.684836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893b7ae-c716-4873-be02-1c40da92d0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.687307 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893b7ae-c716-4873-be02-1c40da92d0b9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.689313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21681899-3c9f-4c83-b405-0942f7fcf079 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3893b7ae-c716-4873-be02-1c40da92d0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:50.706732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:50.707719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:50.708590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:50.708590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:50.708590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:50.708590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 400/792] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:50.714935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893b7ae-c716-4873-be02-1c40da92d0b9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.733784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c351b78-89c2-4c48-a871-d68c2ed6ab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.734588 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351b78-89c2-4c48-a871-d68c2ed6ab6e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.734999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351b78-89c2-4c48-a871-d68c2ed6ab6e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.735284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351b78-89c2-4c48-a871-d68c2ed6ab6e None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.736016 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c351b78-89c2-4c48-a871-d68c2ed6ab6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:50.736321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c351b78-89c2-4c48-a871-d68c2ed6ab6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.738239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c351b78-89c2-4c48-a871-d68c2ed6ab6e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.764463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 393/793] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:50.768446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c351b78-89c2-4c48-a871-d68c2ed6ab6e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.836872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893b7ae-c716-4873-be02-1c40da92d0b9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.866907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.886538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4b860-1a08-431b-ae3b-0d0dd920bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.887600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4b860-1a08-431b-ae3b-0d0dd920bf81 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.888120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4b860-1a08-431b-ae3b-0d0dd920bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.888615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4b860-1a08-431b-ae3b-0d0dd920bf81 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.890014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4b860-1a08-431b-ae3b-0d0dd920bf81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:50.890514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4b860-1a08-431b-ae3b-0d0dd920bf81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.892134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4b860-1a08-431b-ae3b-0d0dd920bf81 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.905866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 401/794] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:50.911825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4b860-1a08-431b-ae3b-0d0dd920bf81 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.997485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.004832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c351b78-89c2-4c48-a871-d68c2ed6ab6e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.052303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4668ef-c0ab-444a-9336-5f1e4ee72092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.052956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4668ef-c0ab-444a-9336-5f1e4ee72092 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.053227 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4668ef-c0ab-444a-9336-5f1e4ee72092 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.053489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4668ef-c0ab-444a-9336-5f1e4ee72092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.064470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4668ef-c0ab-444a-9336-5f1e4ee72092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.065888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4668ef-c0ab-444a-9336-5f1e4ee72092 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.075446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4b860-1a08-431b-ae3b-0d0dd920bf81 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-4d4668ef-c0ab-444a-9336-5f1e4ee72092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:51.081394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.082470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:51.083398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:51.083398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:51.083398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:51.087332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 394/795] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:51.088693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4668ef-c0ab-444a-9336-5f1e4ee72092 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.130033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a6a1e-757f-4eba-afdc-50e3cbea3506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.130971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6a1e-757f-4eba-afdc-50e3cbea3506 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.131522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6a1e-757f-4eba-afdc-50e3cbea3506 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.131980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6a1e-757f-4eba-afdc-50e3cbea3506 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.144114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a6a1e-757f-4eba-afdc-50e3cbea3506 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.145923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a6a1e-757f-4eba-afdc-50e3cbea3506 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-db6a6a1e-757f-4eba-afdc-50e3cbea3506 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:51.162831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.163830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:51.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:51.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:51.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:51.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:51.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:51.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:51.164816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:51.167847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 402/796] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:51.174688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a6a1e-757f-4eba-afdc-50e3cbea3506 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.226634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4668ef-c0ab-444a-9336-5f1e4ee72092 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.237278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.261203 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aec1a5-0a47-49e7-8a2f-cc4269e520c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.261827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec1a5-0a47-49e7-8a2f-cc4269e520c6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.262101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec1a5-0a47-49e7-8a2f-cc4269e520c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.262451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec1a5-0a47-49e7-8a2f-cc4269e520c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.262995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aec1a5-0a47-49e7-8a2f-cc4269e520c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:51.263293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aec1a5-0a47-49e7-8a2f-cc4269e520c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.265449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aec1a5-0a47-49e7-8a2f-cc4269e520c6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.281841 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 395/797] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:51.284434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9eef2-8835-4e57-8351-adc931294393 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.284947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9eef2-8835-4e57-8351-adc931294393 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.288236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9eef2-8835-4e57-8351-adc931294393 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.289792 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 396/798] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:51.292436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9eef2-8835-4e57-8351-adc931294393 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.305725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a6a1e-757f-4eba-afdc-50e3cbea3506 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.307506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.343134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fbb5f-85eb-4038-8764-f94646268027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.343928 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fbb5f-85eb-4038-8764-f94646268027 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.344332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fbb5f-85eb-4038-8764-f94646268027 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.344727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fbb5f-85eb-4038-8764-f94646268027 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.345550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fbb5f-85eb-4038-8764-f94646268027 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:51.345955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fbb5f-85eb-4038-8764-f94646268027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.347472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fbb5f-85eb-4038-8764-f94646268027 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.370166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 403/799] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:51.371605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f0ca6-940a-4023-b0d0-cc72be1b615f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.371990 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f0ca6-940a-4023-b0d0-cc72be1b615f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.372602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f0ca6-940a-4023-b0d0-cc72be1b615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.391079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-729f0ca6-940a-4023-b0d0-cc72be1b615f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:51.392336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-729f0ca6-940a-4023-b0d0-cc72be1b615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:51.425655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9eef2-8835-4e57-8351-adc931294393 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.463235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6584514-e090-4f88-9b89-2132e154a7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.464086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6584514-e090-4f88-9b89-2132e154a7ea None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.464501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6584514-e090-4f88-9b89-2132e154a7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.464935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6584514-e090-4f88-9b89-2132e154a7ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.468423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 404/800] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:51.469523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f0ca6-940a-4023-b0d0-cc72be1b615f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.482998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6584514-e090-4f88-9b89-2132e154a7ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.484892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6584514-e090-4f88-9b89-2132e154a7ea None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.505441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-b6584514-e090-4f88-9b89-2132e154a7ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:51.508224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.509248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.510305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:51.510305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:51.510305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:51.510305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:51.510305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:51.510305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:51.510305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:51.510305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:51.512299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 397/801] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:51.518880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6584514-e090-4f88-9b89-2132e154a7ea None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.577354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f0ca6-940a-4023-b0d0-cc72be1b615f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.596005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.618859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9762453-65d1-454e-b108-4c2711aef801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.619834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762453-65d1-454e-b108-4c2711aef801 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.620385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762453-65d1-454e-b108-4c2711aef801 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.620985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762453-65d1-454e-b108-4c2711aef801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.627277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6584514-e090-4f88-9b89-2132e154a7ea None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.632996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9762453-65d1-454e-b108-4c2711aef801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.634831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9762453-65d1-454e-b108-4c2711aef801 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d9762453-65d1-454e-b108-4c2711aef801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:51.652326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.653295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:51.654221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:51.654221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:51.654221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:51.661006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 405/802] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:51.662170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9762453-65d1-454e-b108-4c2711aef801 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.665317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546c79d-3a21-4a35-bfdf-6c8383ba3e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.665867 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546c79d-3a21-4a35-bfdf-6c8383ba3e23 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.666139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546c79d-3a21-4a35-bfdf-6c8383ba3e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.666404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546c79d-3a21-4a35-bfdf-6c8383ba3e23 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.667805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546c79d-3a21-4a35-bfdf-6c8383ba3e23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:51.667805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546c79d-3a21-4a35-bfdf-6c8383ba3e23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.668822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546c79d-3a21-4a35-bfdf-6c8383ba3e23 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.687257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 398/803] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:51.688163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546c79d-3a21-4a35-bfdf-6c8383ba3e23 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.773027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.781208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9762453-65d1-454e-b108-4c2711aef801 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.793064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546c79d-3a21-4a35-bfdf-6c8383ba3e23 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.820709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f692d1-fd97-4172-b65e-c26bfd61b889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.821674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f692d1-fd97-4172-b65e-c26bfd61b889 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.822153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f692d1-fd97-4172-b65e-c26bfd61b889 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.822729 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.823185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f692d1-fd97-4172-b65e-c26bfd61b889 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.824727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f692d1-fd97-4172-b65e-c26bfd61b889 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.827479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f692d1-fd97-4172-b65e-c26bfd61b889 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.829398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec7cb4-2964-4903-a7b0-fdd7eeae9448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.830278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec7cb4-2964-4903-a7b0-fdd7eeae9448 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.830911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec7cb4-2964-4903-a7b0-fdd7eeae9448 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.831268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec7cb4-2964-4903-a7b0-fdd7eeae9448 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.832130 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec7cb4-2964-4903-a7b0-fdd7eeae9448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:51.832394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec7cb4-2964-4903-a7b0-fdd7eeae9448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.833879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec7cb4-2964-4903-a7b0-fdd7eeae9448 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c6f692d1-fd97-4172-b65e-c26bfd61b889 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.839168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.840125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:09:51.841014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:51.848711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 399/805] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:51.848711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec7cb4-2964-4903-a7b0-fdd7eeae9448 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.849819 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 406/805] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:51.854383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f692d1-fd97-4172-b65e-c26bfd61b889 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.949088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec7cb4-2964-4903-a7b0-fdd7eeae9448 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.976428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f692d1-fd97-4172-b65e-c26bfd61b889 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.984276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c382f9-2763-44a3-b6ca-9ced83293039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.985101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c382f9-2763-44a3-b6ca-9ced83293039 None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.985483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c382f9-2763-44a3-b6ca-9ced83293039 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.985842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c382f9-2763-44a3-b6ca-9ced83293039 None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/6c806e8c13414c38ad398069bfa2f03b/roles/5efe6ea0b4354fd3821aaac43d4595d8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.001182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c382f9-2763-44a3-b6ca-9ced83293039 None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=6c806e8c13414c38ad398069bfa2f03b, role_id=5efe6ea0b4354fd3821aaac43d4595d8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.002728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c382f9-2763-44a3-b6ca-9ced83293039 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.014942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e818c2c-8e39-4dcc-ad39-979fa78531fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.015574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e818c2c-8e39-4dcc-ad39-979fa78531fe None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.015858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e818c2c-8e39-4dcc-ad39-979fa78531fe None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.016129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e818c2c-8e39-4dcc-ad39-979fa78531fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.023241 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e818c2c-8e39-4dcc-ad39-979fa78531fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.024702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 400/806] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:51 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/6c806e8c13414c38ad398069bfa2f03b/roles/5efe6ea0b4354fd3821aaac43d4595d8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:52.024812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e818c2c-8e39-4dcc-ad39-979fa78531fe None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.026031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c382f9-2763-44a3-b6ca-9ced83293039 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-8e818c2c-8e39-4dcc-ad39-979fa78531fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:52.038096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:52.039102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:52.039991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:52.039991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:52.039991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:52.039991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:52.039991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:52.039991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:52.039991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:52.039991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:52.044233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 407/807] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:52.046527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30c77b-8e21-4140-bb9e-930db768b163 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.046818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30c77b-8e21-4140-bb9e-930db768b163 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.047098 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30c77b-8e21-4140-bb9e-930db768b163 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.053066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 408/808] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:52.053066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30c77b-8e21-4140-bb9e-930db768b163 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.067656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.098387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.180318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c382f9-2763-44a3-b6ca-9ced83293039 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.192237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30c77b-8e21-4140-bb9e-930db768b163 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.221167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c226cf4-0c50-40df-8985-ee3c8fe82aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.222267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c226cf4-0c50-40df-8985-ee3c8fe82aed None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.223071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c226cf4-0c50-40df-8985-ee3c8fe82aed None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.223478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c226cf4-0c50-40df-8985-ee3c8fe82aed None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.224237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c226cf4-0c50-40df-8985-ee3c8fe82aed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:52.224541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c226cf4-0c50-40df-8985-ee3c8fe82aed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.226375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c226cf4-0c50-40df-8985-ee3c8fe82aed None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.231299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4928c-47d6-4d84-88ed-28eabf86e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.231541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 401/809] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:52.231988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4928c-47d6-4d84-88ed-28eabf86e9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.232265 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4928c-47d6-4d84-88ed-28eabf86e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.232579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4928c-47d6-4d84-88ed-28eabf86e9c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.232894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae803c45-b993-4179-a429-c022a9d23d56 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.233179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae803c45-b993-4179-a429-c022a9d23d56 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.233291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4928c-47d6-4d84-88ed-28eabf86e9c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:52.233490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae803c45-b993-4179-a429-c022a9d23d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.233590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4928c-47d6-4d84-88ed-28eabf86e9c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.235172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4928c-47d6-4d84-88ed-28eabf86e9c4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.249375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 409/810] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:52.250253 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4928c-47d6-4d84-88ed-28eabf86e9c4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.258007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ae803c45-b993-4179-a429-c022a9d23d56 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:52.259756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ae803c45-b993-4179-a429-c022a9d23d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:52.333700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 402/811] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:52.334529 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae803c45-b993-4179-a429-c022a9d23d56 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.350455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.395746 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.396210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4928c-47d6-4d84-88ed-28eabf86e9c4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.438625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d91e9-f38e-474a-b00d-b25866e69921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.439232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d91e9-f38e-474a-b00d-b25866e69921 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.439509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d91e9-f38e-474a-b00d-b25866e69921 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.439778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d91e9-f38e-474a-b00d-b25866e69921 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.440405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d91e9-f38e-474a-b00d-b25866e69921 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:52.440775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d91e9-f38e-474a-b00d-b25866e69921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.442205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d91e9-f38e-474a-b00d-b25866e69921 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.452330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 410/812] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:52.452330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d91e9-f38e-474a-b00d-b25866e69921 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.486541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae803c45-b993-4179-a429-c022a9d23d56 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.523680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45530476-7fb1-43f6-8807-72121e9564d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.524493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45530476-7fb1-43f6-8807-72121e9564d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.525042 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45530476-7fb1-43f6-8807-72121e9564d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.525417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45530476-7fb1-43f6-8807-72121e9564d5 None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/20f9b96629544596a8d9b81cce57af21/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.528207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45530476-7fb1-43f6-8807-72121e9564d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=20f9b96629544596a8d9b81cce57af21, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.530678 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45530476-7fb1-43f6-8807-72121e9564d5 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.552653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 403/813] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:52 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/20f9b96629544596a8d9b81cce57af21/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:52.552653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45530476-7fb1-43f6-8807-72121e9564d5 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.588853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d91e9-f38e-474a-b00d-b25866e69921 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.632651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e7d10-d85c-42c6-ab88-a2dfe80f3995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.632651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7d10-d85c-42c6-ab88-a2dfe80f3995 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.632651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7d10-d85c-42c6-ab88-a2dfe80f3995 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.632651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7d10-d85c-42c6-ab88-a2dfe80f3995 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.634127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.647053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e7d10-d85c-42c6-ab88-a2dfe80f3995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-983e7d10-d85c-42c6-ab88-a2dfe80f3995 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:52.652070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:52.653037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:52.653886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 411/814] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:52.661600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e7d10-d85c-42c6-ab88-a2dfe80f3995 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.713519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.721691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45530476-7fb1-43f6-8807-72121e9564d5 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.765435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ff571-de26-474c-8f98-8d6b44d7d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.765977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff571-de26-474c-8f98-8d6b44d7d9e5 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.766252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff571-de26-474c-8f98-8d6b44d7d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.766518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff571-de26-474c-8f98-8d6b44d7d9e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.767183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ff571-de26-474c-8f98-8d6b44d7d9e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.768554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ff571-de26-474c-8f98-8d6b44d7d9e5 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.796475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 404/815] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:09:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:52.797698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a9c7d-3707-4634-9bd6-440e0185a6df None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.797986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a9c7d-3707-4634-9bd6-440e0185a6df None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.798264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a9c7d-3707-4634-9bd6-440e0185a6df None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.800043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 405/816] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:52.800928 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e7d10-d85c-42c6-ab88-a2dfe80f3995 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.805636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729634-78e6-480a-b4e1-2d8625ce3b4f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.805945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729634-78e6-480a-b4e1-2d8625ce3b4f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.806183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729634-78e6-480a-b4e1-2d8625ce3b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.833958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c3729634-78e6-480a-b4e1-2d8625ce3b4f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:52.835326 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c3729634-78e6-480a-b4e1-2d8625ce3b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:52.868563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f6634-5d4f-459e-91b2-ae8fa4013eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.869223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f6634-5d4f-459e-91b2-ae8fa4013eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.869500 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f6634-5d4f-459e-91b2-ae8fa4013eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.869769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f6634-5d4f-459e-91b2-ae8fa4013eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.870452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f6634-5d4f-459e-91b2-ae8fa4013eb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:52.872399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f6634-5d4f-459e-91b2-ae8fa4013eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.878698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f6634-5d4f-459e-91b2-ae8fa4013eb5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.893483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 412/817] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:52.900243 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f6634-5d4f-459e-91b2-ae8fa4013eb5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.950600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 406/818] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:09:52.978963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.979540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3729634-78e6-480a-b4e1-2d8625ce3b4f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.035067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f6634-5d4f-459e-91b2-ae8fa4013eb5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.072185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a56409-fa5f-487e-9483-60e4f2634f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.072841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56409-fa5f-487e-9483-60e4f2634f57 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.073116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56409-fa5f-487e-9483-60e4f2634f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.073382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56409-fa5f-487e-9483-60e4f2634f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.087731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a56409-fa5f-487e-9483-60e4f2634f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.089223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a56409-fa5f-487e-9483-60e4f2634f57 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-b0a56409-fa5f-487e-9483-60e4f2634f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:53.105284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:53.106285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:53.107662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:53.107662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:53.107662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:53.107662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 413/819] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:53.112743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a56409-fa5f-487e-9483-60e4f2634f57 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.116963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.142188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3729634-78e6-480a-b4e1-2d8625ce3b4f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.186558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bc844-63c2-456e-bf95-43d4a92c68be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.187191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc844-63c2-456e-bf95-43d4a92c68be None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.187466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc844-63c2-456e-bf95-43d4a92c68be None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.187730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc844-63c2-456e-bf95-43d4a92c68be None admin] PATH_INFO: `/v3/services/network` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.188309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bc844-63c2-456e-bf95-43d4a92c68be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.189714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bc844-63c2-456e-bf95-43d4a92c68be None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-130bc844-63c2-456e-bf95-43d4a92c68be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:53.200000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:53.201162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:53.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 407/820] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:53.207826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bc844-63c2-456e-bf95-43d4a92c68be None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.264251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a56409-fa5f-487e-9483-60e4f2634f57 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.267888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.307611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde869c-94ee-4e0a-928d-d9ca90cb4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.308133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde869c-94ee-4e0a-928d-d9ca90cb4adf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.308410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde869c-94ee-4e0a-928d-d9ca90cb4adf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.308707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde869c-94ee-4e0a-928d-d9ca90cb4adf None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.309347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde869c-94ee-4e0a-928d-d9ca90cb4adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:53.310046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde869c-94ee-4e0a-928d-d9ca90cb4adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.313731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde869c-94ee-4e0a-928d-d9ca90cb4adf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.331562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 414/821] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:53.337970 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde869c-94ee-4e0a-928d-d9ca90cb4adf None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.407264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bc844-63c2-456e-bf95-43d4a92c68be None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.479452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dc616-b2bf-47b9-a30a-cd33151cde8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.480056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dc616-b2bf-47b9-a30a-cd33151cde8f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.480329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dc616-b2bf-47b9-a30a-cd33151cde8f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.480592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dc616-b2bf-47b9-a30a-cd33151cde8f None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.481237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dc616-b2bf-47b9-a30a-cd33151cde8f None admin] RBAC: Adding query filter params (name=network) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:53.481531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dc616-b2bf-47b9-a30a-cd33151cde8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.483882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dc616-b2bf-47b9-a30a-cd33151cde8f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.494019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 408/822] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:53.499815 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dc616-b2bf-47b9-a30a-cd33151cde8f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.516648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde869c-94ee-4e0a-928d-d9ca90cb4adf None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.518886 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.555640 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85851ed1-6721-485d-aa82-ca7d737d8085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.556271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85851ed1-6721-485d-aa82-ca7d737d8085 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.556549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85851ed1-6721-485d-aa82-ca7d737d8085 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.556856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85851ed1-6721-485d-aa82-ca7d737d8085 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.565832 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85851ed1-6721-485d-aa82-ca7d737d8085 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.567199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85851ed1-6721-485d-aa82-ca7d737d8085 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-85851ed1-6721-485d-aa82-ca7d737d8085 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:53.580510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:53.581495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:53.582422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 415/823] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:53.588814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85851ed1-6721-485d-aa82-ca7d737d8085 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.620091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.703054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85851ed1-6721-485d-aa82-ca7d737d8085 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.742494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dc616-b2bf-47b9-a30a-cd33151cde8f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.747428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b1a8-4ebb-48c2-8cdf-9d56da730249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.748839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b1a8-4ebb-48c2-8cdf-9d56da730249 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.749157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b1a8-4ebb-48c2-8cdf-9d56da730249 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.749427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b1a8-4ebb-48c2-8cdf-9d56da730249 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.750156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1b1a8-4ebb-48c2-8cdf-9d56da730249 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:53.750456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1b1a8-4ebb-48c2-8cdf-9d56da730249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.751885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1b1a8-4ebb-48c2-8cdf-9d56da730249 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.781768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 416/824] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:53.793616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b1a8-4ebb-48c2-8cdf-9d56da730249 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.815082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d46fc-88f6-4648-b750-2382c85eedf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.815728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d46fc-88f6-4648-b750-2382c85eedf6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.816029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d46fc-88f6-4648-b750-2382c85eedf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.816244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d46fc-88f6-4648-b750-2382c85eedf6 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.816901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d46fc-88f6-4648-b750-2382c85eedf6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:53.817205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d46fc-88f6-4648-b750-2382c85eedf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.818858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d46fc-88f6-4648-b750-2382c85eedf6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.831275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 409/825] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:53.837088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d46fc-88f6-4648-b750-2382c85eedf6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.929937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.952418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b1a8-4ebb-48c2-8cdf-9d56da730249 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.996183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dafcac-92bc-4d00-996f-1c92e8cd1b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.997361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dafcac-92bc-4d00-996f-1c92e8cd1b91 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.998992 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dafcac-92bc-4d00-996f-1c92e8cd1b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.999523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dafcac-92bc-4d00-996f-1c92e8cd1b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.017679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.078633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d46fc-88f6-4648-b750-2382c85eedf6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.112916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dafcac-92bc-4d00-996f-1c92e8cd1b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.114689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dafcac-92bc-4d00-996f-1c92e8cd1b91 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.153916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668005b-82dc-4031-a58c-80f0362513d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.155372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668005b-82dc-4031-a58c-80f0362513d4 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.155634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668005b-82dc-4031-a58c-80f0362513d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.155909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668005b-82dc-4031-a58c-80f0362513d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.156578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668005b-82dc-4031-a58c-80f0362513d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.158252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668005b-82dc-4031-a58c-80f0362513d4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.200347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.212648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 410/826] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:09:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:54.238797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 417/827] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:09:54.244468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668005b-82dc-4031-a58c-80f0362513d4 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.411350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668005b-82dc-4031-a58c-80f0362513d4 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.440907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.456102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf23af-aa9f-4930-8b80-c39b71369260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.457132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf23af-aa9f-4930-8b80-c39b71369260 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.457639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf23af-aa9f-4930-8b80-c39b71369260 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.458109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf23af-aa9f-4930-8b80-c39b71369260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.471536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf23af-aa9f-4930-8b80-c39b71369260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.474981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf23af-aa9f-4930-8b80-c39b71369260 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.484071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450311f5-f94c-404c-b367-837dff86e44a None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.484600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450311f5-f94c-404c-b367-837dff86e44a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.484600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450311f5-f94c-404c-b367-837dff86e44a None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.490000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 418/828] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:54.491146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4e68b-b345-4bae-8968-0f9ae1a1b1c0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.491422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4e68b-b345-4bae-8968-0f9ae1a1b1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.491689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4e68b-b345-4bae-8968-0f9ae1a1b1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-6bbf23af-aa9f-4930-8b80-c39b71369260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:54.494672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:54.495622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:54.496481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:54.496481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:54.496481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:54.499440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 411/829] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:54.505097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf23af-aa9f-4930-8b80-c39b71369260 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.513352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a9e4e68b-b345-4bae-8968-0f9ae1a1b1c0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:54.515284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a9e4e68b-b345-4bae-8968-0f9ae1a1b1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:54.595429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 419/830] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:54.620524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4e68b-b345-4bae-8968-0f9ae1a1b1c0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.630006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf23af-aa9f-4930-8b80-c39b71369260 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.699575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4b11c-eede-458d-bf00-a9a4c9d75798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.699575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4b11c-eede-458d-bf00-a9a4c9d75798 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.699575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4b11c-eede-458d-bf00-a9a4c9d75798 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.699575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4b11c-eede-458d-bf00-a9a4c9d75798 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.699993 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4b11c-eede-458d-bf00-a9a4c9d75798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:54.700388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4b11c-eede-458d-bf00-a9a4c9d75798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.706728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4b11c-eede-458d-bf00-a9a4c9d75798 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.730888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 412/831] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:54.737873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4b11c-eede-458d-bf00-a9a4c9d75798 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.742938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4e68b-b345-4bae-8968-0f9ae1a1b1c0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.756521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.784817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.787298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c670ae9-7631-471f-93af-2c254a5bf89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.788199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c670ae9-7631-471f-93af-2c254a5bf89f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.788739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c670ae9-7631-471f-93af-2c254a5bf89f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.789251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c670ae9-7631-471f-93af-2c254a5bf89f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.812027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c670ae9-7631-471f-93af-2c254a5bf89f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-1c670ae9-7631-471f-93af-2c254a5bf89f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:54.817448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:54.818461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:54.819288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:54.822340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 420/832] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:54.828711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c670ae9-7631-471f-93af-2c254a5bf89f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.866507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4b11c-eede-458d-bf00-a9a4c9d75798 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.908072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38e911-e640-47c4-ace8-c5445447b78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.908716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e911-e640-47c4-ace8-c5445447b78c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.908992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e911-e640-47c4-ace8-c5445447b78c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.909251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e911-e640-47c4-ace8-c5445447b78c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.915902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38e911-e640-47c4-ace8-c5445447b78c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.917361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38e911-e640-47c4-ace8-c5445447b78c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-fc38e911-e640-47c4-ace8-c5445447b78c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:54.929996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:54.931031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:54.932403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:54.932403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:54.932403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:54.932403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:54.932403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:54.932403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:54.932403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:54.932403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:54.932403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 413/833] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:54.937999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180007f-76d6-4a04-a0f5-e30a21678980 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.938279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180007f-76d6-4a04-a0f5-e30a21678980 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.938543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180007f-76d6-4a04-a0f5-e30a21678980 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.943903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 414/834] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:54.943903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180007f-76d6-4a04-a0f5-e30a21678980 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.947909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c670ae9-7631-471f-93af-2c254a5bf89f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.984519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa4b17-d9aa-4ec0-a86c-c70d2e20138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.985203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa4b17-d9aa-4ec0-a86c-c70d2e20138d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.985572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa4b17-d9aa-4ec0-a86c-c70d2e20138d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.985934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa4b17-d9aa-4ec0-a86c-c70d2e20138d None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.986683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa4b17-d9aa-4ec0-a86c-c70d2e20138d None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:54.987084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa4b17-d9aa-4ec0-a86c-c70d2e20138d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.988543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa4b17-d9aa-4ec0-a86c-c70d2e20138d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.001710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 421/835] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:55.001710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cefaf1-cd77-439e-bdde-4c7ef7aa9f57 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.001710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cefaf1-cd77-439e-bdde-4c7ef7aa9f57 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.001710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cefaf1-cd77-439e-bdde-4c7ef7aa9f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.018341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f1cefaf1-cd77-439e-bdde-4c7ef7aa9f57 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:55.019508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f1cefaf1-cd77-439e-bdde-4c7ef7aa9f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:55.047598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.053306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.061604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180007f-76d6-4a04-a0f5-e30a21678980 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.104793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 422/836] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:55.104793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cefaf1-cd77-439e-bdde-4c7ef7aa9f57 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.114218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0fcec-977e-4f91-9f27-b99fd2584b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.115142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0fcec-977e-4f91-9f27-b99fd2584b21 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.115561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0fcec-977e-4f91-9f27-b99fd2584b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.115968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0fcec-977e-4f91-9f27-b99fd2584b21 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.116879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0fcec-977e-4f91-9f27-b99fd2584b21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:55.117340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0fcec-977e-4f91-9f27-b99fd2584b21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.119086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0fcec-977e-4f91-9f27-b99fd2584b21 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.132611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 415/837] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:55.133647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0fcec-977e-4f91-9f27-b99fd2584b21 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.217700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cefaf1-cd77-439e-bdde-4c7ef7aa9f57 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.247338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0fcec-977e-4f91-9f27-b99fd2584b21 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.253129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc1ef0-1407-46f9-86e5-0aa208e967fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.253756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc1ef0-1407-46f9-86e5-0aa208e967fa None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.254028 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc1ef0-1407-46f9-86e5-0aa208e967fa None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.254296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc1ef0-1407-46f9-86e5-0aa208e967fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.264847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc1ef0-1407-46f9-86e5-0aa208e967fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.266274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc1ef0-1407-46f9-86e5-0aa208e967fa None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-3bdc1ef0-1407-46f9-86e5-0aa208e967fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:55.280460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:55.281430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:55.287207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:55.287207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:55.287207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:55.287207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 423/838] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:55.287207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc1ef0-1407-46f9-86e5-0aa208e967fa None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.292581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaf9fb-547e-42c7-91da-3369efef9717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.293239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaf9fb-547e-42c7-91da-3369efef9717 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.293514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaf9fb-547e-42c7-91da-3369efef9717 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.293775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaf9fb-547e-42c7-91da-3369efef9717 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.304721 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.311380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaf9fb-547e-42c7-91da-3369efef9717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-fadaf9fb-547e-42c7-91da-3369efef9717 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:55.316507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:55.317471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:55.318294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:55.322690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 416/839] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:55.323272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaf9fb-547e-42c7-91da-3369efef9717 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.344969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.394336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc1ef0-1407-46f9-86e5-0aa208e967fa None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.428851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739509f1-16fd-43ad-b66e-2f6db67d6592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.429450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739509f1-16fd-43ad-b66e-2f6db67d6592 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.429723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739509f1-16fd-43ad-b66e-2f6db67d6592 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.430008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739509f1-16fd-43ad-b66e-2f6db67d6592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.430722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739509f1-16fd-43ad-b66e-2f6db67d6592 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=98925192a33544e081f1a02faed60b7f) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:55.431019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739509f1-16fd-43ad-b66e-2f6db67d6592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.432424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739509f1-16fd-43ad-b66e-2f6db67d6592 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.438890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 424/840] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/role_assignments?user.id=98925192a33544e081f1a02faed60b7f&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=d6155b01aace49f887f29aa2861d31cf => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:55.439661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739509f1-16fd-43ad-b66e-2f6db67d6592 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.458829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaf9fb-547e-42c7-91da-3369efef9717 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.499374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78aea0-a578-4a78-b18d-e9351a587dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.500378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78aea0-a578-4a78-b18d-e9351a587dbf None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.500893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78aea0-a578-4a78-b18d-e9351a587dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.501327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78aea0-a578-4a78-b18d-e9351a587dbf None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.502268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78aea0-a578-4a78-b18d-e9351a587dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:55.502858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78aea0-a578-4a78-b18d-e9351a587dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.504280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78aea0-a578-4a78-b18d-e9351a587dbf None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.523805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 417/841] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:55.523805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e008-16d3-4bc9-8eb2-4c98a39e8245 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.523805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e008-16d3-4bc9-8eb2-4c98a39e8245 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.523805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e008-16d3-4bc9-8eb2-4c98a39e8245 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.523805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 418/842] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:55.527623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430e008-16d3-4bc9-8eb2-4c98a39e8245 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.532151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.556269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739509f1-16fd-43ad-b66e-2f6db67d6592 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.597499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c928bd-8c9d-460b-87b9-e698d0d48317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.598103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c928bd-8c9d-460b-87b9-e698d0d48317 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.598378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c928bd-8c9d-460b-87b9-e698d0d48317 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.598658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c928bd-8c9d-460b-87b9-e698d0d48317 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.599305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c928bd-8c9d-460b-87b9-e698d0d48317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:55.599599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c928bd-8c9d-460b-87b9-e698d0d48317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.600977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c928bd-8c9d-460b-87b9-e698d0d48317 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.614771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 425/843] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:55.615996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f537c-1db8-4c17-84aa-0545207bf39f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.616373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f537c-1db8-4c17-84aa-0545207bf39f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.616762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f537c-1db8-4c17-84aa-0545207bf39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.619050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.637870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-342f537c-1db8-4c17-84aa-0545207bf39f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:55.639660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-342f537c-1db8-4c17-84aa-0545207bf39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:55.646931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430e008-16d3-4bc9-8eb2-4c98a39e8245 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.682391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcb1f4-68a1-4c90-b363-429571cae38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.683018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb1f4-68a1-4c90-b363-429571cae38c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.683295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb1f4-68a1-4c90-b363-429571cae38c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.683562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb1f4-68a1-4c90-b363-429571cae38c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.691600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcb1f4-68a1-4c90-b363-429571cae38c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.693089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcb1f4-68a1-4c90-b363-429571cae38c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-11fcb1f4-68a1-4c90-b363-429571cae38c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:55.705437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:55.706563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:55.707715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 419/844] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:55.711811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcb1f4-68a1-4c90-b363-429571cae38c None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.719997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 426/845] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:55.720987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f537c-1db8-4c17-84aa-0545207bf39f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.797808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.821804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcb1f4-68a1-4c90-b363-429571cae38c None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.829168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f537c-1db8-4c17-84aa-0545207bf39f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.858985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df455b8a-daaa-4b22-88ae-eb2157ca0c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.859874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df455b8a-daaa-4b22-88ae-eb2157ca0c90 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.860367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df455b8a-daaa-4b22-88ae-eb2157ca0c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.860810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df455b8a-daaa-4b22-88ae-eb2157ca0c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.863364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866e470-3cae-4740-b65e-fe716a8ea4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.863961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866e470-3cae-4740-b65e-fe716a8ea4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.864071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.864232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866e470-3cae-4740-b65e-fe716a8ea4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.864497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866e470-3cae-4740-b65e-fe716a8ea4c7 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.865239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866e470-3cae-4740-b65e-fe716a8ea4c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:55.865612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866e470-3cae-4740-b65e-fe716a8ea4c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.867206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866e470-3cae-4740-b65e-fe716a8ea4c7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.874359 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df455b8a-daaa-4b22-88ae-eb2157ca0c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.876440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df455b8a-daaa-4b22-88ae-eb2157ca0c90 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.885447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 427/846] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:55.886096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866e470-3cae-4740-b65e-fe716a8ea4c7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-df455b8a-daaa-4b22-88ae-eb2157ca0c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:55.896164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:55.897360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:55.898496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:55.898496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:55.898496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:55.905391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 420/847] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:55.905391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df455b8a-daaa-4b22-88ae-eb2157ca0c90 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.001238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866e470-3cae-4740-b65e-fe716a8ea4c7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.017755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df455b8a-daaa-4b22-88ae-eb2157ca0c90 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.031354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.037742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1089e8-a4bc-404f-9e50-44b22736675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.038368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1089e8-a4bc-404f-9e50-44b22736675a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.038642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1089e8-a4bc-404f-9e50-44b22736675a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.038910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1089e8-a4bc-404f-9e50-44b22736675a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.039481 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1089e8-a4bc-404f-9e50-44b22736675a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.040856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1089e8-a4bc-404f-9e50-44b22736675a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-cc1089e8-a4bc-404f-9e50-44b22736675a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:56.050270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:56.051412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:56.052233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 428/848] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:56.053062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1089e8-a4bc-404f-9e50-44b22736675a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.062711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb766a5-e13b-465d-9b2a-919a43953f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.063514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb766a5-e13b-465d-9b2a-919a43953f5f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.063942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb766a5-e13b-465d-9b2a-919a43953f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.064364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb766a5-e13b-465d-9b2a-919a43953f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.122245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.137491 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb766a5-e13b-465d-9b2a-919a43953f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.140249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb766a5-e13b-465d-9b2a-919a43953f5f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.164360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1089e8-a4bc-404f-9e50-44b22736675a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.200711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52213e5d-70e9-48d5-8585-b89fbbb3049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.201305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52213e5d-70e9-48d5-8585-b89fbbb3049e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.201576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52213e5d-70e9-48d5-8585-b89fbbb3049e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.201835 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52213e5d-70e9-48d5-8585-b89fbbb3049e None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.202470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52213e5d-70e9-48d5-8585-b89fbbb3049e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:56.202771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52213e5d-70e9-48d5-8585-b89fbbb3049e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.204133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52213e5d-70e9-48d5-8585-b89fbbb3049e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.216516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 429/849] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:56.217838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52213e5d-70e9-48d5-8585-b89fbbb3049e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.256673 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 421/850] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:09:56.256673 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb766a5-e13b-465d-9b2a-919a43953f5f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.278777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.324345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52213e5d-70e9-48d5-8585-b89fbbb3049e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.347673 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.360416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b865d-c35c-43d3-9361-a02dc6076b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.361052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b865d-c35c-43d3-9361-a02dc6076b12 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.361333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b865d-c35c-43d3-9361-a02dc6076b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.361603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b865d-c35c-43d3-9361-a02dc6076b12 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.361702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb766a5-e13b-465d-9b2a-919a43953f5f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.362220 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b865d-c35c-43d3-9361-a02dc6076b12 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:56.362515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b865d-c35c-43d3-9361-a02dc6076b12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.363872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b865d-c35c-43d3-9361-a02dc6076b12 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.368234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 430/851] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:56.369033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b865d-c35c-43d3-9361-a02dc6076b12 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.405747 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bda13-4246-4133-bdc6-0e1241a8b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.406383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bda13-4246-4133-bdc6-0e1241a8b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.406662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bda13-4246-4133-bdc6-0e1241a8b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.406932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bda13-4246-4133-bdc6-0e1241a8b2a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.414293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bda13-4246-4133-bdc6-0e1241a8b2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.416983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bda13-4246-4133-bdc6-0e1241a8b2a6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-591bda13-4246-4133-bdc6-0e1241a8b2a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:56.429575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:56.430722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:56.431668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 422/852] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:56.432245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bda13-4246-4133-bdc6-0e1241a8b2a6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.490993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b865d-c35c-43d3-9361-a02dc6076b12 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.508563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.526603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3b136-da08-4576-a5d0-e0a9abc78b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.527229 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3b136-da08-4576-a5d0-e0a9abc78b29 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.527508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3b136-da08-4576-a5d0-e0a9abc78b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.527783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3b136-da08-4576-a5d0-e0a9abc78b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.538485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3b136-da08-4576-a5d0-e0a9abc78b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.539557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bda13-4246-4133-bdc6-0e1241a8b2a6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.539920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3b136-da08-4576-a5d0-e0a9abc78b29 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-4af3b136-da08-4576-a5d0-e0a9abc78b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:56.556666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:56.557649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:56.558528 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:56.558528 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:56.558528 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:56.562232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 431/853] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:56.563084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3b136-da08-4576-a5d0-e0a9abc78b29 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.578451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1425d2-951d-4fb5-9469-fc8a345f3322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.578991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1425d2-951d-4fb5-9469-fc8a345f3322 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.579270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1425d2-951d-4fb5-9469-fc8a345f3322 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.579540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1425d2-951d-4fb5-9469-fc8a345f3322 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.580165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1425d2-951d-4fb5-9469-fc8a345f3322 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:56.580464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1425d2-951d-4fb5-9469-fc8a345f3322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.581861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1425d2-951d-4fb5-9469-fc8a345f3322 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.586420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 423/854] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:56.587211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1425d2-951d-4fb5-9469-fc8a345f3322 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.611681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.710767 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3b136-da08-4576-a5d0-e0a9abc78b29 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.717448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1425d2-951d-4fb5-9469-fc8a345f3322 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.758621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76425b-675e-4413-9ab3-d2f41f9e5e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.759623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76425b-675e-4413-9ab3-d2f41f9e5e72 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.759908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76425b-675e-4413-9ab3-d2f41f9e5e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.760180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76425b-675e-4413-9ab3-d2f41f9e5e72 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.760852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76425b-675e-4413-9ab3-d2f41f9e5e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:56.761267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76425b-675e-4413-9ab3-d2f41f9e5e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.762851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76425b-675e-4413-9ab3-d2f41f9e5e72 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.764103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114fbad-bb89-4067-9ab5-49f2e232a057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.764974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114fbad-bb89-4067-9ab5-49f2e232a057 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.765264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114fbad-bb89-4067-9ab5-49f2e232a057 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.765532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114fbad-bb89-4067-9ab5-49f2e232a057 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.768681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114fbad-bb89-4067-9ab5-49f2e232a057 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:56.768681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114fbad-bb89-4067-9ab5-49f2e232a057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.768681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114fbad-bb89-4067-9ab5-49f2e232a057 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.776300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 424/855] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:56.784111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76425b-675e-4413-9ab3-d2f41f9e5e72 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.789991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 432/856] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:56.796871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114fbad-bb89-4067-9ab5-49f2e232a057 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.836832 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.869735 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.913581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114fbad-bb89-4067-9ab5-49f2e232a057 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.914487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76425b-675e-4413-9ab3-d2f41f9e5e72 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.954879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84b6a1-7f56-4592-aba3-51957efb9599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.955524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84b6a1-7f56-4592-aba3-51957efb9599 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.955801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84b6a1-7f56-4592-aba3-51957efb9599 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.956076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84b6a1-7f56-4592-aba3-51957efb9599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.964430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ecf08-c62f-4371-8886-a5c7dc5b8d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.965844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ecf08-c62f-4371-8886-a5c7dc5b8d78 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.966275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ecf08-c62f-4371-8886-a5c7dc5b8d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.966840 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ecf08-c62f-4371-8886-a5c7dc5b8d78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.976393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ecf08-c62f-4371-8886-a5c7dc5b8d78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.978701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ecf08-c62f-4371-8886-a5c7dc5b8d78 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-f41ecf08-c62f-4371-8886-a5c7dc5b8d78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:56.995377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:56.996484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:56.997448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:56.997448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:56.997448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:56.997448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:56.997448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:56.997448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:56.997448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:56.997448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:56.999925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 425/857] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:57.005578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ecf08-c62f-4371-8886-a5c7dc5b8d78 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.036937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84b6a1-7f56-4592-aba3-51957efb9599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.038412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84b6a1-7f56-4592-aba3-51957efb9599 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.071616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.140052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ecf08-c62f-4371-8886-a5c7dc5b8d78 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.152935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 433/858] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 12:09:57.158484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84b6a1-7f56-4592-aba3-51957efb9599 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.183804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.192447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdda46a-e022-491b-bfb3-a73de404d21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.193776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda46a-e022-491b-bfb3-a73de404d21a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.194543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda46a-e022-491b-bfb3-a73de404d21a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.195004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda46a-e022-491b-bfb3-a73de404d21a None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.196176 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdda46a-e022-491b-bfb3-a73de404d21a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:57.197099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdda46a-e022-491b-bfb3-a73de404d21a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.199023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdda46a-e022-491b-bfb3-a73de404d21a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.215942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 426/859] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:57.222109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdda46a-e022-491b-bfb3-a73de404d21a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.286165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84b6a1-7f56-4592-aba3-51957efb9599 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.316292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.326638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2110228-cedb-4355-a78a-ec53e55d68f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.327629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110228-cedb-4355-a78a-ec53e55d68f2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.328133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110228-cedb-4355-a78a-ec53e55d68f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.328611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110228-cedb-4355-a78a-ec53e55d68f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.340488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2110228-cedb-4355-a78a-ec53e55d68f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.341590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdda46a-e022-491b-bfb3-a73de404d21a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.342701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2110228-cedb-4355-a78a-ec53e55d68f2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c2110228-cedb-4355-a78a-ec53e55d68f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:57.359281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:57.360255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:57.361300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:57.361300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:57.361300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:57.367871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 434/860] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:57.369242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2110228-cedb-4355-a78a-ec53e55d68f2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.377589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe83bac-ab09-43da-94e7-bb05b9334605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.378196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe83bac-ab09-43da-94e7-bb05b9334605 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.378487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe83bac-ab09-43da-94e7-bb05b9334605 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.378798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe83bac-ab09-43da-94e7-bb05b9334605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.379529 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe83bac-ab09-43da-94e7-bb05b9334605 None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=6c806e8c13414c38ad398069bfa2f03b) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:57.379834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe83bac-ab09-43da-94e7-bb05b9334605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.381296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe83bac-ab09-43da-94e7-bb05b9334605 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.392867 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 427/861] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/role_assignments?user.id=6c806e8c13414c38ad398069bfa2f03b&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:57.490038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2110228-cedb-4355-a78a-ec53e55d68f2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.529336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9051cf-cc84-4e5e-b81f-ca5cd83f1600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.530107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9051cf-cc84-4e5e-b81f-ca5cd83f1600 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.530390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9051cf-cc84-4e5e-b81f-ca5cd83f1600 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.530663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9051cf-cc84-4e5e-b81f-ca5cd83f1600 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.531319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9051cf-cc84-4e5e-b81f-ca5cd83f1600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:57.531622 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9051cf-cc84-4e5e-b81f-ca5cd83f1600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.533133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9051cf-cc84-4e5e-b81f-ca5cd83f1600 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.533589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29236-6c49-4d5d-8975-b280ec6c94fe None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.533872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29236-6c49-4d5d-8975-b280ec6c94fe None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.534218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29236-6c49-4d5d-8975-b280ec6c94fe None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.535823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 428/862] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:57.541114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a91a5-fe73-46ba-9246-c34e49bff8c8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.541438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a91a5-fe73-46ba-9246-c34e49bff8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.543133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a91a5-fe73-46ba-9246-c34e49bff8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.547861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 435/863] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:57.553575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9051cf-cc84-4e5e-b81f-ca5cd83f1600 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.563460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c51a91a5-fe73-46ba-9246-c34e49bff8c8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:57.565360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c51a91a5-fe73-46ba-9246-c34e49bff8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:57.605627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.640078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.667114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 429/864] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:09:57.681575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9051cf-cc84-4e5e-b81f-ca5cd83f1600 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.697697 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a91a5-fe73-46ba-9246-c34e49bff8c8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.719235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9b3f1-0a0f-49e1-ac4e-aa9b0ffebb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.719628 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9b3f1-0a0f-49e1-ac4e-aa9b0ffebb29 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.719895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9b3f1-0a0f-49e1-ac4e-aa9b0ffebb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.720164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9b3f1-0a0f-49e1-ac4e-aa9b0ffebb29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.727647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9b3f1-0a0f-49e1-ac4e-aa9b0ffebb29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.728730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9b3f1-0a0f-49e1-ac4e-aa9b0ffebb29 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-72e9b3f1-0a0f-49e1-ac4e-aa9b0ffebb29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:57.740259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:57.741233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:57.742164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:57.742164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:57.742164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:57.742164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:57.742164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:57.742164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:57.742164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:57.742164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:09:57.742164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 436/865] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:57.749619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9b3f1-0a0f-49e1-ac4e-aa9b0ffebb29 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.836717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a91a5-fe73-46ba-9246-c34e49bff8c8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.859386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.863394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9b3f1-0a0f-49e1-ac4e-aa9b0ffebb29 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.883371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c93ed-7dca-40fb-a1a5-c5425659f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.884003 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c93ed-7dca-40fb-a1a5-c5425659f37b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.884286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c93ed-7dca-40fb-a1a5-c5425659f37b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.884558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c93ed-7dca-40fb-a1a5-c5425659f37b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.885187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c93ed-7dca-40fb-a1a5-c5425659f37b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.886554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c93ed-7dca-40fb-a1a5-c5425659f37b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-1b7c93ed-7dca-40fb-a1a5-c5425659f37b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:57.896123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:57.897150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:09:57.898039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:57.902398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 430/866] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:57.903252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c93ed-7dca-40fb-a1a5-c5425659f37b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.915259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d5082-fa71-4d5c-be98-abeea9336d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.916589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d5082-fa71-4d5c-be98-abeea9336d31 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.917324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d5082-fa71-4d5c-be98-abeea9336d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.917845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d5082-fa71-4d5c-be98-abeea9336d31 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.918700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d5082-fa71-4d5c-be98-abeea9336d31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:57.919406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d5082-fa71-4d5c-be98-abeea9336d31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.921284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d5082-fa71-4d5c-be98-abeea9336d31 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.941951 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 437/867] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:57.943258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d5082-fa71-4d5c-be98-abeea9336d31 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.976427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.039887 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c93ed-7dca-40fb-a1a5-c5425659f37b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.059822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d5082-fa71-4d5c-be98-abeea9336d31 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.085770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d218be-325b-48d1-98b0-a0e3ac86275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.086392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d218be-325b-48d1-98b0-a0e3ac86275d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.086676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d218be-325b-48d1-98b0-a0e3ac86275d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.086948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d218be-325b-48d1-98b0-a0e3ac86275d None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.088014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d218be-325b-48d1-98b0-a0e3ac86275d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:58.088317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d218be-325b-48d1-98b0-a0e3ac86275d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.090295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d218be-325b-48d1-98b0-a0e3ac86275d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.099470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f070760-d445-4211-9f44-cb4344da39f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.100394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f070760-d445-4211-9f44-cb4344da39f0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.100910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f070760-d445-4211-9f44-cb4344da39f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.101432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f070760-d445-4211-9f44-cb4344da39f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.101551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 431/868] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:58.102360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d218be-325b-48d1-98b0-a0e3ac86275d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.102671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f070760-d445-4211-9f44-cb4344da39f0 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=20f9b96629544596a8d9b81cce57af21) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:58.103169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f070760-d445-4211-9f44-cb4344da39f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.104798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f070760-d445-4211-9f44-cb4344da39f0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.112205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 438/869] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/role_assignments?user.id=20f9b96629544596a8d9b81cce57af21&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=d6155b01aace49f887f29aa2861d31cf => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:58.232532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d218be-325b-48d1-98b0-a0e3ac86275d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.248359 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.272647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53415d-b7e8-44ce-bf21-1c5264924bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.273274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53415d-b7e8-44ce-bf21-1c5264924bbf None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.273552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53415d-b7e8-44ce-bf21-1c5264924bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.273825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53415d-b7e8-44ce-bf21-1c5264924bbf None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.274463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53415d-b7e8-44ce-bf21-1c5264924bbf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:58.274764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53415d-b7e8-44ce-bf21-1c5264924bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.276154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53415d-b7e8-44ce-bf21-1c5264924bbf None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.282698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 432/870] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:58.691251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4214c-09fe-4267-9ac6-e90cc2947275 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.691855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4214c-09fe-4267-9ac6-e90cc2947275 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.691855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4214c-09fe-4267-9ac6-e90cc2947275 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.693410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 439/871] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:58.698832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573469-8298-4fa8-b3a9-93f9d38a90df None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.699111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573469-8298-4fa8-b3a9-93f9d38a90df None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.699376 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573469-8298-4fa8-b3a9-93f9d38a90df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.719397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-31573469-8298-4fa8-b3a9-93f9d38a90df None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:58.720573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-31573469-8298-4fa8-b3a9-93f9d38a90df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:58.802607 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 433/872] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:58.824956 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4214c-09fe-4267-9ac6-e90cc2947275 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.855784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.936936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4214c-09fe-4267-9ac6-e90cc2947275 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.973005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f887a3-876f-4852-8023-aa80d27f1d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.973580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f887a3-876f-4852-8023-aa80d27f1d3b None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.973858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f887a3-876f-4852-8023-aa80d27f1d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.974125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f887a3-876f-4852-8023-aa80d27f1d3b None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.974768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f887a3-876f-4852-8023-aa80d27f1d3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.976119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f887a3-876f-4852-8023-aa80d27f1d3b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.993617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 440/873] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:09:58 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:59.591985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fcd8d-e6b6-4a5c-9126-b54c601bd607 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.592607 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fcd8d-e6b6-4a5c-9126-b54c601bd607 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.592607 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fcd8d-e6b6-4a5c-9126-b54c601bd607 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.599932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 434/874] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:09:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:59.601643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabd387-795a-48d9-9fdc-d1d0e38b48a3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.602259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabd387-795a-48d9-9fdc-d1d0e38b48a3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.602629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabd387-795a-48d9-9fdc-d1d0e38b48a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.621276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2cabd387-795a-48d9-9fdc-d1d0e38b48a3 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:59.622551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2cabd387-795a-48d9-9fdc-d1d0e38b48a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:59.698739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 441/875] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:09:59.721790 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fcd8d-e6b6-4a5c-9126-b54c601bd607 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.834659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fcd8d-e6b6-4a5c-9126-b54c601bd607 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.845640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:59.871951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5e793-5cf4-44e1-b513-064b89b3ec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:59.872568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e793-5cf4-44e1-b513-064b89b3ec8c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.873464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e793-5cf4-44e1-b513-064b89b3ec8c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.874011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e793-5cf4-44e1-b513-064b89b3ec8c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.885218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5e793-5cf4-44e1-b513-064b89b3ec8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-10d5e793-5cf4-44e1-b513-064b89b3ec8c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:59.890990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:59.891933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:09:59.892816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 435/876] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:59.898209 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabd387-795a-48d9-9fdc-d1d0e38b48a3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.912965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.010237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabd387-795a-48d9-9fdc-d1d0e38b48a3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.046734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72698-e6c1-46a6-a2b7-814e9a3af9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.047339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72698-e6c1-46a6-a2b7-814e9a3af9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.047612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72698-e6c1-46a6-a2b7-814e9a3af9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.047879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72698-e6c1-46a6-a2b7-814e9a3af9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.048922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72698-e6c1-46a6-a2b7-814e9a3af9b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:00.049277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72698-e6c1-46a6-a2b7-814e9a3af9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.050635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72698-e6c1-46a6-a2b7-814e9a3af9b8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.059369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 442/877] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:00.065083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5e793-5cf4-44e1-b513-064b89b3ec8c None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.170796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5e793-5cf4-44e1-b513-064b89b3ec8c None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.204857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be43f92-e291-4f60-8882-8a7c6abe921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.205480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be43f92-e291-4f60-8882-8a7c6abe921a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.205752 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be43f92-e291-4f60-8882-8a7c6abe921a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.206015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be43f92-e291-4f60-8882-8a7c6abe921a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.217240 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be43f92-e291-4f60-8882-8a7c6abe921a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.218645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be43f92-e291-4f60-8882-8a7c6abe921a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-7be43f92-e291-4f60-8882-8a7c6abe921a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:00.233120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:00.234092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:00.234976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:00.234976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:00.234976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:00.234976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 436/878] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:00.240352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72698-e6c1-46a6-a2b7-814e9a3af9b8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.259973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba503032-789d-4a4d-a3f3-b8cff09f9702 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.260310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba503032-789d-4a4d-a3f3-b8cff09f9702 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.260508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba503032-789d-4a4d-a3f3-b8cff09f9702 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.262094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 437/879] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:00.268110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3f5e9-66e2-4f4c-9d89-3c2b2c6683da None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.268385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3f5e9-66e2-4f4c-9d89-3c2b2c6683da None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.268672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3f5e9-66e2-4f4c-9d89-3c2b2c6683da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.288125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4fd3f5e9-66e2-4f4c-9d89-3c2b2c6683da None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:00.289330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4fd3f5e9-66e2-4f4c-9d89-3c2b2c6683da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:00.304955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.327577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.366087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72698-e6c1-46a6-a2b7-814e9a3af9b8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.371704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 438/880] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:00.394518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3f5e9-66e2-4f4c-9d89-3c2b2c6683da None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.413822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4ca04-5f39-4761-8b6e-167176934fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.417725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4ca04-5f39-4761-8b6e-167176934fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.418256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4ca04-5f39-4761-8b6e-167176934fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.418718 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4ca04-5f39-4761-8b6e-167176934fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.420953 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4ca04-5f39-4761-8b6e-167176934fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:00.421457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4ca04-5f39-4761-8b6e-167176934fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.423087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4ca04-5f39-4761-8b6e-167176934fd3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.442664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 443/881] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:00.444599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4ca04-5f39-4761-8b6e-167176934fd3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.507589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3f5e9-66e2-4f4c-9d89-3c2b2c6683da None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.547037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4ca04-5f39-4761-8b6e-167176934fd3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.548074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53fd3e-7f3b-4458-bb85-8bf8ceda8eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.549357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53fd3e-7f3b-4458-bb85-8bf8ceda8eda None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.550604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53fd3e-7f3b-4458-bb85-8bf8ceda8eda None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.551084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53fd3e-7f3b-4458-bb85-8bf8ceda8eda None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.551858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53fd3e-7f3b-4458-bb85-8bf8ceda8eda None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.553520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53fd3e-7f3b-4458-bb85-8bf8ceda8eda None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-ad53fd3e-7f3b-4458-bb85-8bf8ceda8eda None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:00.564715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:00.565701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:00.566560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 439/882] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:00.567338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5c2a-8f0e-40c2-912e-3ca030a56be0 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.567338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5c2a-8f0e-40c2-912e-3ca030a56be0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.567465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5c2a-8f0e-40c2-912e-3ca030a56be0 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.568846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 440/883] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:00.573340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa5c2a-8f0e-40c2-912e-3ca030a56be0 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.583824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.589451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.590153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78edca4-d02b-438b-9738-c1deaefadedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.590926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78edca4-d02b-438b-9738-c1deaefadedf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.591267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78edca4-d02b-438b-9738-c1deaefadedf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.592042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78edca4-d02b-438b-9738-c1deaefadedf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.601718 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78edca4-d02b-438b-9738-c1deaefadedf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.603153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78edca4-d02b-438b-9738-c1deaefadedf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f78edca4-d02b-438b-9738-c1deaefadedf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:00.616793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:00.617764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:00.618772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 444/884] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:00.619348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a205c4-358a-4632-9de3-032254bbedf4 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.619925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a205c4-358a-4632-9de3-032254bbedf4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.619925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a205c4-358a-4632-9de3-032254bbedf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.637927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b9a205c4-358a-4632-9de3-032254bbedf4 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:00.639348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b9a205c4-358a-4632-9de3-032254bbedf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:00.689132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa5c2a-8f0e-40c2-912e-3ca030a56be0 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.713088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 445/885] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:00.713088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a205c4-358a-4632-9de3-032254bbedf4 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.727953 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cd148-dc57-473a-9b6a-0f286544a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.728553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cd148-dc57-473a-9b6a-0f286544a393 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.728973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cd148-dc57-473a-9b6a-0f286544a393 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.729238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cd148-dc57-473a-9b6a-0f286544a393 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.729863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cd148-dc57-473a-9b6a-0f286544a393 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:00.730157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cd148-dc57-473a-9b6a-0f286544a393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.731512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cd148-dc57-473a-9b6a-0f286544a393 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.737362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 441/886] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:00.738251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cd148-dc57-473a-9b6a-0f286544a393 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.825633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.826672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a205c4-358a-4632-9de3-032254bbedf4 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.849310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cd148-dc57-473a-9b6a-0f286544a393 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.850223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.864202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ea89-dd7e-4892-88de-60d8ad57bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.864842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ea89-dd7e-4892-88de-60d8ad57bbef None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.865120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ea89-dd7e-4892-88de-60d8ad57bbef None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.865386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ea89-dd7e-4892-88de-60d8ad57bbef None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.866108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3ea89-dd7e-4892-88de-60d8ad57bbef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:00.866408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3ea89-dd7e-4892-88de-60d8ad57bbef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.867863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3ea89-dd7e-4892-88de-60d8ad57bbef None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.885894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6d41f-db19-4c32-813f-181027b74c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.886576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 446/887] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:00.887286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ea89-dd7e-4892-88de-60d8ad57bbef None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.891157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6d41f-db19-4c32-813f-181027b74c1e None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.891460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6d41f-db19-4c32-813f-181027b74c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.891735 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6d41f-db19-4c32-813f-181027b74c1e None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.892389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6d41f-db19-4c32-813f-181027b74c1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.893802 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6d41f-db19-4c32-813f-181027b74c1e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.912319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 442/888] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:00 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:00.913181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6d41f-db19-4c32-813f-181027b74c1e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.015515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ea89-dd7e-4892-88de-60d8ad57bbef None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.060147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a22e24-fd76-414a-8852-5343ce352bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.061291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a22e24-fd76-414a-8852-5343ce352bba None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.061566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a22e24-fd76-414a-8852-5343ce352bba None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.061834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a22e24-fd76-414a-8852-5343ce352bba None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.062473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a22e24-fd76-414a-8852-5343ce352bba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.062773 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a22e24-fd76-414a-8852-5343ce352bba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.064156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a22e24-fd76-414a-8852-5343ce352bba None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.066476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6d41f-db19-4c32-813f-181027b74c1e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.077231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 447/889] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:01.099309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebdd6b-e9db-4967-b500-5dfaf1ec9aa7 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.099629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebdd6b-e9db-4967-b500-5dfaf1ec9aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.099853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebdd6b-e9db-4967-b500-5dfaf1ec9aa7 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.101255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 448/890] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:01.106915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e30f0-c167-4b75-a6d4-8340de95a473 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.107775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e30f0-c167-4b75-a6d4-8340de95a473 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.108045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e30f0-c167-4b75-a6d4-8340de95a473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.112114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64185d-089e-4a77-a9cb-c7c9e2bc9ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.112770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64185d-089e-4a77-a9cb-c7c9e2bc9ace None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.113045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64185d-089e-4a77-a9cb-c7c9e2bc9ace None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.113311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64185d-089e-4a77-a9cb-c7c9e2bc9ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.117590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.136505 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-752e30f0-c167-4b75-a6d4-8340de95a473 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:01.138126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-752e30f0-c167-4b75-a6d4-8340de95a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:01.188026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.209512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64185d-089e-4a77-a9cb-c7c9e2bc9ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.211159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64185d-089e-4a77-a9cb-c7c9e2bc9ace None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.236827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 449/891] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:01.258098 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e30f0-c167-4b75-a6d4-8340de95a473 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.345828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 443/892] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:01.350930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64185d-089e-4a77-a9cb-c7c9e2bc9ace None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.395308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.412177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e30f0-c167-4b75-a6d4-8340de95a473 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.448777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57930-ce4c-432c-820b-8f37998e45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.449408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57930-ce4c-432c-820b-8f37998e45f6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.449682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57930-ce4c-432c-820b-8f37998e45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.449950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57930-ce4c-432c-820b-8f37998e45f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.450527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e57930-ce4c-432c-820b-8f37998e45f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.453020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e57930-ce4c-432c-820b-8f37998e45f6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-26e57930-ce4c-432c-820b-8f37998e45f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:01.462171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:01.463225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:01.464362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 450/893] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:01.469369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57930-ce4c-432c-820b-8f37998e45f6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.485747 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64185d-089e-4a77-a9cb-c7c9e2bc9ace None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.514424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.534355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701e544-02c3-429e-a649-11bd4807f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.535471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701e544-02c3-429e-a649-11bd4807f8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.535897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701e544-02c3-429e-a649-11bd4807f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.536736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701e544-02c3-429e-a649-11bd4807f8a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.551154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701e544-02c3-429e-a649-11bd4807f8a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.553545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701e544-02c3-429e-a649-11bd4807f8a1 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-d701e544-02c3-429e-a649-11bd4807f8a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:01.573860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:01.575105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:01.576648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:01.576648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:01.576648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:01.583032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 444/894] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:01.583525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701e544-02c3-429e-a649-11bd4807f8a1 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.608822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57930-ce4c-432c-820b-8f37998e45f6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.654561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469d0d-a14b-4c06-8acb-80e58f64dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.655171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469d0d-a14b-4c06-8acb-80e58f64dc97 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.655442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469d0d-a14b-4c06-8acb-80e58f64dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.655706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469d0d-a14b-4c06-8acb-80e58f64dc97 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.656582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469d0d-a14b-4c06-8acb-80e58f64dc97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.656929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469d0d-a14b-4c06-8acb-80e58f64dc97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.659156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469d0d-a14b-4c06-8acb-80e58f64dc97 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.665470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 451/895] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:01.673314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469d0d-a14b-4c06-8acb-80e58f64dc97 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.680120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.698418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701e544-02c3-429e-a649-11bd4807f8a1 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.737802 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca7923-ef35-47bd-a7f7-f6b026b5afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.738545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca7923-ef35-47bd-a7f7-f6b026b5afa9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.738890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca7923-ef35-47bd-a7f7-f6b026b5afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.739304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca7923-ef35-47bd-a7f7-f6b026b5afa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.740109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca7923-ef35-47bd-a7f7-f6b026b5afa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.740476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca7923-ef35-47bd-a7f7-f6b026b5afa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.741998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca7923-ef35-47bd-a7f7-f6b026b5afa9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.755636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 445/896] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:01.760872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca7923-ef35-47bd-a7f7-f6b026b5afa9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.775746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.781431 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469d0d-a14b-4c06-8acb-80e58f64dc97 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.816039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b2cfe-ce85-40c7-8434-492e0f93ebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.816838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b2cfe-ce85-40c7-8434-492e0f93ebf7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.817211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b2cfe-ce85-40c7-8434-492e0f93ebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.817569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b2cfe-ce85-40c7-8434-492e0f93ebf7 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.818304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b2cfe-ce85-40c7-8434-492e0f93ebf7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.818697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b2cfe-ce85-40c7-8434-492e0f93ebf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.820129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b2cfe-ce85-40c7-8434-492e0f93ebf7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.825501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 452/897] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:01.831785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b2cfe-ce85-40c7-8434-492e0f93ebf7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.884311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca7923-ef35-47bd-a7f7-f6b026b5afa9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.923212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317c2ca-cb98-45f7-b26a-1e6887f61273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.924493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317c2ca-cb98-45f7-b26a-1e6887f61273 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.925002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317c2ca-cb98-45f7-b26a-1e6887f61273 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.925633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317c2ca-cb98-45f7-b26a-1e6887f61273 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.933216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317c2ca-cb98-45f7-b26a-1e6887f61273 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.934841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b2cfe-ce85-40c7-8434-492e0f93ebf7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.935107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317c2ca-cb98-45f7-b26a-1e6887f61273 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-4317c2ca-cb98-45f7-b26a-1e6887f61273 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:01.947430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:01.948334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:01.949250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:01.949250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:01.949250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:01.949250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:01.949250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:01.949250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:01.949250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:01.949250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:01.952268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 446/898] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:01.957562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317c2ca-cb98-45f7-b26a-1e6887f61273 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.970264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.971180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb7dcd-a512-4e75-8797-94c66ae7ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.971783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb7dcd-a512-4e75-8797-94c66ae7ead2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.972700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb7dcd-a512-4e75-8797-94c66ae7ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.972700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb7dcd-a512-4e75-8797-94c66ae7ead2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.973217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb7dcd-a512-4e75-8797-94c66ae7ead2 None admin] RBAC: Adding query filter params (interface=public, service_id=10881c09bd5e4683b9f4e5146a32bc8c, region_id=RegionOne) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.973519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb7dcd-a512-4e75-8797-94c66ae7ead2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.974910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb7dcd-a512-4e75-8797-94c66ae7ead2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.985886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 453/899] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/endpoints?service_id=10881c09bd5e4683b9f4e5146a32bc8c&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:01.988012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb7dcd-a512-4e75-8797-94c66ae7ead2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.025821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:02.090417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317c2ca-cb98-45f7-b26a-1e6887f61273 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.108330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb7dcd-a512-4e75-8797-94c66ae7ead2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.130227 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274914-66e3-4b23-bac1-7410cdbc13fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.131181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274914-66e3-4b23-bac1-7410cdbc13fa None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.131659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274914-66e3-4b23-bac1-7410cdbc13fa None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.132132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274914-66e3-4b23-bac1-7410cdbc13fa None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.133059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1274914-66e3-4b23-bac1-7410cdbc13fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:02.133590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1274914-66e3-4b23-bac1-7410cdbc13fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.135267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1274914-66e3-4b23-bac1-7410cdbc13fa None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.144071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83857404-85cb-418d-9798-dcabcb51bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.144699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83857404-85cb-418d-9798-dcabcb51bb12 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.144978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83857404-85cb-418d-9798-dcabcb51bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.145244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83857404-85cb-418d-9798-dcabcb51bb12 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.145853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83857404-85cb-418d-9798-dcabcb51bb12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.147343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83857404-85cb-418d-9798-dcabcb51bb12 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.150769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 447/900] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:02.160437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274914-66e3-4b23-bac1-7410cdbc13fa None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.160693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 454/901] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:10:02.241082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:02.284392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274914-66e3-4b23-bac1-7410cdbc13fa None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.322544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36331c-74d1-4dab-b3c1-7381a26bf4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.323526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36331c-74d1-4dab-b3c1-7381a26bf4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.324025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36331c-74d1-4dab-b3c1-7381a26bf4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.324504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36331c-74d1-4dab-b3c1-7381a26bf4c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.325448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36331c-74d1-4dab-b3c1-7381a26bf4c4 None admin] RBAC: Adding query filter params (role.id=b6c2fce401ec4816aae2928181962c37, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=6c806e8c13414c38ad398069bfa2f03b) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:02.325990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36331c-74d1-4dab-b3c1-7381a26bf4c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.327722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36331c-74d1-4dab-b3c1-7381a26bf4c4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.333899 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 448/902] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:02 2022] GET /identity/v3/role_assignments?user.id=6c806e8c13414c38ad398069bfa2f03b&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=b6c2fce401ec4816aae2928181962c37 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:03.073171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303cf63-6967-40fd-8d19-5e6b535fdd8d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.073717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303cf63-6967-40fd-8d19-5e6b535fdd8d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.073717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303cf63-6967-40fd-8d19-5e6b535fdd8d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.075300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 455/903] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:03.081066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147ed8-301d-47ee-baa9-7bf1e53af255 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.081933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147ed8-301d-47ee-baa9-7bf1e53af255 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.082264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3147ed8-301d-47ee-baa9-7bf1e53af255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.102594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-e3147ed8-301d-47ee-baa9-7bf1e53af255 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:03.103774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e3147ed8-301d-47ee-baa9-7bf1e53af255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:03.174515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 449/904] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:03.192734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed89b-ebb5-4ab9-afc1-370316cd5fcd None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.193011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed89b-ebb5-4ab9-afc1-370316cd5fcd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.193277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed89b-ebb5-4ab9-afc1-370316cd5fcd None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.194843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 456/905] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:03.197882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3147ed8-301d-47ee-baa9-7bf1e53af255 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.199625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aff72-07c8-49a4-b8a4-fea329d06882 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.200118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aff72-07c8-49a4-b8a4-fea329d06882 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.200599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aff72-07c8-49a4-b8a4-fea329d06882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.219983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-856aff72-07c8-49a4-b8a4-fea329d06882 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:03.221556 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-856aff72-07c8-49a4-b8a4-fea329d06882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:03.270469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.290836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 457/906] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:03.315237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3147ed8-301d-47ee-baa9-7bf1e53af255 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.319741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aff72-07c8-49a4-b8a4-fea329d06882 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.343707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.354138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707092f6-6c47-418a-b855-765e3223d07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.354785 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707092f6-6c47-418a-b855-765e3223d07c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.355065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707092f6-6c47-418a-b855-765e3223d07c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.355332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707092f6-6c47-418a-b855-765e3223d07c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.355906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707092f6-6c47-418a-b855-765e3223d07c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.357386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707092f6-6c47-418a-b855-765e3223d07c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-707092f6-6c47-418a-b855-765e3223d07c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:03.366765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:03.367757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:03.369032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 450/907] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:03.374145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707092f6-6c47-418a-b855-765e3223d07c None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.451902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aff72-07c8-49a4-b8a4-fea329d06882 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.490146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf9f52-6ae0-41b5-9548-5d76917c4702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.490776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf9f52-6ae0-41b5-9548-5d76917c4702 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.491054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf9f52-6ae0-41b5-9548-5d76917c4702 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.491322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf9f52-6ae0-41b5-9548-5d76917c4702 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.491960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf9f52-6ae0-41b5-9548-5d76917c4702 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.493418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf9f52-6ae0-41b5-9548-5d76917c4702 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.512333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 458/908] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:03 2022] POST /identity/v3/services => generated 241 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:03.527623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707092f6-6c47-418a-b855-765e3223d07c None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.557539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.577877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef725faa-aab2-4b13-91a1-50d27d96c204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.578748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef725faa-aab2-4b13-91a1-50d27d96c204 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.579232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef725faa-aab2-4b13-91a1-50d27d96c204 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.579697 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef725faa-aab2-4b13-91a1-50d27d96c204 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.580484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef725faa-aab2-4b13-91a1-50d27d96c204 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:03.581029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef725faa-aab2-4b13-91a1-50d27d96c204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.582684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef725faa-aab2-4b13-91a1-50d27d96c204 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.589060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 451/909] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:03.597782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf9f52-6ae0-41b5-9548-5d76917c4702 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.687562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.711577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf9f52-6ae0-41b5-9548-5d76917c4702 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.746650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5571f94-a3d5-4724-a538-4f256232ac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.747253 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5571f94-a3d5-4724-a538-4f256232ac9f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.748054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5571f94-a3d5-4724-a538-4f256232ac9f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.748334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5571f94-a3d5-4724-a538-4f256232ac9f None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.749048 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5571f94-a3d5-4724-a538-4f256232ac9f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:03.749350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5571f94-a3d5-4724-a538-4f256232ac9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.750711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5571f94-a3d5-4724-a538-4f256232ac9f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.756166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 459/910] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:03.761791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef725faa-aab2-4b13-91a1-50d27d96c204 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.868822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef725faa-aab2-4b13-91a1-50d27d96c204 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.906548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6832de-ba81-4b09-92b7-ded3dd31850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.907182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6832de-ba81-4b09-92b7-ded3dd31850f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.907462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6832de-ba81-4b09-92b7-ded3dd31850f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.907734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6832de-ba81-4b09-92b7-ded3dd31850f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.908438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6832de-ba81-4b09-92b7-ded3dd31850f None admin] RBAC: Adding query filter params (interface=public, service_id=69c2f3d311654ed3822060b95cdc23ae, region_id=RegionOne) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:03.908774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6832de-ba81-4b09-92b7-ded3dd31850f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.910147 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6832de-ba81-4b09-92b7-ded3dd31850f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.918362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 452/911] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/endpoints?service_id=69c2f3d311654ed3822060b95cdc23ae&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:03.924264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5571f94-a3d5-4724-a538-4f256232ac9f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.030379 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5571f94-a3d5-4724-a538-4f256232ac9f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.066930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1de21-37ae-4754-93f1-c5ed9ecabda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.067900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1de21-37ae-4754-93f1-c5ed9ecabda9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.068389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1de21-37ae-4754-93f1-c5ed9ecabda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.068881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1de21-37ae-4754-93f1-c5ed9ecabda9 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.069672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1de21-37ae-4754-93f1-c5ed9ecabda9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.071228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1de21-37ae-4754-93f1-c5ed9ecabda9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.078740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 460/912] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:10:04.344825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a026-437c-4129-b983-7260cba7312f None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.345325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a026-437c-4129-b983-7260cba7312f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.345325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a026-437c-4129-b983-7260cba7312f None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.346925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 453/913] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:04.352164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2352a-899a-4614-b7fe-1a4a5cc8948f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.352451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2352a-899a-4614-b7fe-1a4a5cc8948f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.352761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2352a-899a-4614-b7fe-1a4a5cc8948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.371168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e5639-8e5c-42eb-8e3c-4cfa84d5c9ae None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.371468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e5639-8e5c-42eb-8e3c-4cfa84d5c9ae None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.371644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e8d2352a-899a-4614-b7fe-1a4a5cc8948f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:04.371747 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e5639-8e5c-42eb-8e3c-4cfa84d5c9ae None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.373700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e8d2352a-899a-4614-b7fe-1a4a5cc8948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:04.374001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 454/914] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:04.375842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.378854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3cbfc-2c37-4a37-8127-3e25e65e8029 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.379136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3cbfc-2c37-4a37-8127-3e25e65e8029 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.379862 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3cbfc-2c37-4a37-8127-3e25e65e8029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.402662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-bfe3cbfc-2c37-4a37-8127-3e25e65e8029 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:04.403949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bfe3cbfc-2c37-4a37-8127-3e25e65e8029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:04.456689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.463577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 461/915] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:04.482192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 455/916] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:04.489740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2352a-899a-4614-b7fe-1a4a5cc8948f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.508011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3cbfc-2c37-4a37-8127-3e25e65e8029 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.613646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2352a-899a-4614-b7fe-1a4a5cc8948f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.614668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3cbfc-2c37-4a37-8127-3e25e65e8029 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.655544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c278286-9a1a-4e73-9f8b-b5192b9131bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.656297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278286-9a1a-4e73-9f8b-b5192b9131bd None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.656748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278286-9a1a-4e73-9f8b-b5192b9131bd None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.657063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278286-9a1a-4e73-9f8b-b5192b9131bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.657891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04d9fc-afe1-4318-9b4f-2be0c36eaadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.659029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04d9fc-afe1-4318-9b4f-2be0c36eaadf None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.659543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04d9fc-afe1-4318-9b4f-2be0c36eaadf None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.660443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04d9fc-afe1-4318-9b4f-2be0c36eaadf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.661259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04d9fc-afe1-4318-9b4f-2be0c36eaadf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.663146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04d9fc-afe1-4318-9b4f-2be0c36eaadf None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.667857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c278286-9a1a-4e73-9f8b-b5192b9131bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-8c278286-9a1a-4e73-9f8b-b5192b9131bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:04.672574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:04.673549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:04.674647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-5d04d9fc-afe1-4318-9b4f-2be0c36eaadf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:04.677188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:04.678146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:04.679565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:04.680295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 456/917] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:04.680295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c278286-9a1a-4e73-9f8b-b5192b9131bd None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.687520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 462/918] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:04.689900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04d9fc-afe1-4318-9b4f-2be0c36eaadf None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.692889 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.728326 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.804531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c278286-9a1a-4e73-9f8b-b5192b9131bd None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.821673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04d9fc-afe1-4318-9b4f-2be0c36eaadf None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.854077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50371-af1e-4677-93ae-55c309fb8e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.855315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50371-af1e-4677-93ae-55c309fb8e44 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.855893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50371-af1e-4677-93ae-55c309fb8e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.856437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50371-af1e-4677-93ae-55c309fb8e44 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.857945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50371-af1e-4677-93ae-55c309fb8e44 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:04.858654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50371-af1e-4677-93ae-55c309fb8e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.859469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7560fa-c8b7-448d-af9d-87b0c8ef603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.860073 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7560fa-c8b7-448d-af9d-87b0c8ef603d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.860350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7560fa-c8b7-448d-af9d-87b0c8ef603d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.860636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7560fa-c8b7-448d-af9d-87b0c8ef603d None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.861249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50371-af1e-4677-93ae-55c309fb8e44 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.861371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7560fa-c8b7-448d-af9d-87b0c8ef603d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:04.861552 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7560fa-c8b7-448d-af9d-87b0c8ef603d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.862898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7560fa-c8b7-448d-af9d-87b0c8ef603d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.871937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 457/919] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:04.875003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 463/920] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:04.876016 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50371-af1e-4677-93ae-55c309fb8e44 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.878125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7560fa-c8b7-448d-af9d-87b0c8ef603d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.951454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.991121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7560fa-c8b7-448d-af9d-87b0c8ef603d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.007162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:05.010883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50371-af1e-4677-93ae-55c309fb8e44 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.031638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986690d-3ec0-4506-b576-dd2aca986cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.033521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986690d-3ec0-4506-b576-dd2aca986cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.033907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986690d-3ec0-4506-b576-dd2aca986cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.034284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986690d-3ec0-4506-b576-dd2aca986cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.049350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986690d-3ec0-4506-b576-dd2aca986cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.050825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986690d-3ec0-4506-b576-dd2aca986cb2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.053009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4bbfc-497c-4685-863a-fa3e6e1f87ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.053856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4bbfc-497c-4685-863a-fa3e6e1f87ae None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.054331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4bbfc-497c-4685-863a-fa3e6e1f87ae None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.054795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4bbfc-497c-4685-863a-fa3e6e1f87ae None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.055678 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4bbfc-497c-4685-863a-fa3e6e1f87ae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:05.056173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4bbfc-497c-4685-863a-fa3e6e1f87ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.058064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4bbfc-497c-4685-863a-fa3e6e1f87ae None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.064660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 458/921] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:05.070173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4bbfc-497c-4685-863a-fa3e6e1f87ae None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d986690d-3ec0-4506-b576-dd2aca986cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:05.071529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:05.072452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:05.073453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:05.073453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:05.073453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:05.078939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 464/922] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:05.082417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986690d-3ec0-4506-b576-dd2aca986cb2 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.185040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4bbfc-497c-4685-863a-fa3e6e1f87ae None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.202888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986690d-3ec0-4506-b576-dd2aca986cb2 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.223158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:05.232717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbab4d-5e71-4593-aed0-1aac86059608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.233340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbab4d-5e71-4593-aed0-1aac86059608 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.234040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbab4d-5e71-4593-aed0-1aac86059608 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.234330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbab4d-5e71-4593-aed0-1aac86059608 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.235521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbab4d-5e71-4593-aed0-1aac86059608 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.237202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbab4d-5e71-4593-aed0-1aac86059608 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.246185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb33284-9876-4ac4-adb7-fd6ecb9696eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.247494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb33284-9876-4ac4-adb7-fd6ecb9696eb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.248265 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb33284-9876-4ac4-adb7-fd6ecb9696eb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.248855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb33284-9876-4ac4-adb7-fd6ecb9696eb None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.249903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb33284-9876-4ac4-adb7-fd6ecb9696eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:05.250533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb33284-9876-4ac4-adb7-fd6ecb9696eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.252398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb33284-9876-4ac4-adb7-fd6ecb9696eb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.271043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 459/923] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:05.276940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 465/924] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:05.280309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbab4d-5e71-4593-aed0-1aac86059608 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.308555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:05.409605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbab4d-5e71-4593-aed0-1aac86059608 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.449572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70983d94-a549-400f-8f4c-b831df596584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.450429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70983d94-a549-400f-8f4c-b831df596584 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.451573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70983d94-a549-400f-8f4c-b831df596584 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.452006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70983d94-a549-400f-8f4c-b831df596584 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.460293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70983d94-a549-400f-8f4c-b831df596584 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.461955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70983d94-a549-400f-8f4c-b831df596584 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-70983d94-a549-400f-8f4c-b831df596584 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:05.473343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:05.474507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:05.475623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:05.475623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:05.475623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:05.475623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:05.475623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:05.475623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:05.475623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:05.475623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:05.475623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:05.475623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:05.480321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 460/925] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 9 12:10:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:05.484177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb33284-9876-4ac4-adb7-fd6ecb9696eb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.601616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb33284-9876-4ac4-adb7-fd6ecb9696eb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.638393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026fd2-386d-4c83-929b-82bd851ecd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.639353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026fd2-386d-4c83-929b-82bd851ecd65 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.639852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026fd2-386d-4c83-929b-82bd851ecd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.640346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026fd2-386d-4c83-929b-82bd851ecd65 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.641345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0026fd2-386d-4c83-929b-82bd851ecd65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:05.641850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0026fd2-386d-4c83-929b-82bd851ecd65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.643514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0026fd2-386d-4c83-929b-82bd851ecd65 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.648118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517eaf-9fbe-4702-b786-59612dba0cd3 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.648397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517eaf-9fbe-4702-b786-59612dba0cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.648706 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517eaf-9fbe-4702-b786-59612dba0cd3 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.650280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 461/926] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:05.655387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dc418-ec11-4c2d-b99f-ee3bc84e3657 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.655660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dc418-ec11-4c2d-b99f-ee3bc84e3657 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.655927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dc418-ec11-4c2d-b99f-ee3bc84e3657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.666894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 466/927] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 9 12:10:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:05.673171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026fd2-386d-4c83-929b-82bd851ecd65 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.675298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-962dc418-ec11-4c2d-b99f-ee3bc84e3657 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:05.676530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-962dc418-ec11-4c2d-b99f-ee3bc84e3657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:05.713707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:05.760906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 462/928] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:05.777136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dc418-ec11-4c2d-b99f-ee3bc84e3657 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.782511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026fd2-386d-4c83-929b-82bd851ecd65 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.805604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:05.820370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719db15-1405-4f4c-90da-ceb54a641b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.821035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719db15-1405-4f4c-90da-ceb54a641b3e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.821311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719db15-1405-4f4c-90da-ceb54a641b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.821712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719db15-1405-4f4c-90da-ceb54a641b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.837844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719db15-1405-4f4c-90da-ceb54a641b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.839358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719db15-1405-4f4c-90da-ceb54a641b3e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f719db15-1405-4f4c-90da-ceb54a641b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:05.862097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:05.863087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:05.863977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:05.863977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:05.863977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:05.868564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 467/929] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:05.869625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719db15-1405-4f4c-90da-ceb54a641b3e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.906446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dc418-ec11-4c2d-b99f-ee3bc84e3657 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.949590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecd67b-c9a4-4626-9848-9bc97a68a03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.950620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecd67b-c9a4-4626-9848-9bc97a68a03e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.951853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecd67b-c9a4-4626-9848-9bc97a68a03e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.952516 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecd67b-c9a4-4626-9848-9bc97a68a03e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.953351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecd67b-c9a4-4626-9848-9bc97a68a03e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.954915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecd67b-c9a4-4626-9848-9bc97a68a03e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-0eecd67b-c9a4-4626-9848-9bc97a68a03e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:05.964469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:05.965633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:05.967277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:05.974883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 463/930] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:05.975712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:05.977121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecd67b-c9a4-4626-9848-9bc97a68a03e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.987173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719db15-1405-4f4c-90da-ceb54a641b3e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:06.035275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b18927-9da1-43fe-b404-810553f72a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:06.035890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b18927-9da1-43fe-b404-810553f72a53 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.036167 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b18927-9da1-43fe-b404-810553f72a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.036438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b18927-9da1-43fe-b404-810553f72a53 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.037113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b18927-9da1-43fe-b404-810553f72a53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:06.037413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b18927-9da1-43fe-b404-810553f72a53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:06.038780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b18927-9da1-43fe-b404-810553f72a53 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:06.056353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 468/931] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:06.062272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b18927-9da1-43fe-b404-810553f72a53 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:06.062877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:06.099645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecd67b-c9a4-4626-9848-9bc97a68a03e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:06.137467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774eaa-ede9-4e07-82c8-fb68b1b2172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:06.138681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774eaa-ede9-4e07-82c8-fb68b1b2172f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.139240 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774eaa-ede9-4e07-82c8-fb68b1b2172f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.139788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774eaa-ede9-4e07-82c8-fb68b1b2172f None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.140742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774eaa-ede9-4e07-82c8-fb68b1b2172f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:06.141314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774eaa-ede9-4e07-82c8-fb68b1b2172f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:06.142881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774eaa-ede9-4e07-82c8-fb68b1b2172f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:06.148412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 464/932] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:06.155030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774eaa-ede9-4e07-82c8-fb68b1b2172f None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:06.181590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b18927-9da1-43fe-b404-810553f72a53 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:06.222206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0628455-1496-4231-940b-81386c6e7901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:06.222912 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0628455-1496-4231-940b-81386c6e7901 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.223292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0628455-1496-4231-940b-81386c6e7901 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.223652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0628455-1496-4231-940b-81386c6e7901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.230474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0628455-1496-4231-940b-81386c6e7901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:06.232696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0628455-1496-4231-940b-81386c6e7901 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e0628455-1496-4231-940b-81386c6e7901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:06.243739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:06.244816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:06.245790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:06.245790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:06.245790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:06.245790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:06.245790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:06.245790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:06.245790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:06.245790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:06.245790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 469/933] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:06.246648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc84b-9590-49ae-933e-35434c4bd85f None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.246747 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc84b-9590-49ae-933e-35434c4bd85f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.246980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc84b-9590-49ae-933e-35434c4bd85f None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.248712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 470/934] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:06.253171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bc84b-9590-49ae-933e-35434c4bd85f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:06.266322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:06.274115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774eaa-ede9-4e07-82c8-fb68b1b2172f None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:06.311019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0bc73-cac7-4bd6-85c9-2fb3a89d390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:06.311664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0bc73-cac7-4bd6-85c9-2fb3a89d390b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.311942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0bc73-cac7-4bd6-85c9-2fb3a89d390b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.312206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0bc73-cac7-4bd6-85c9-2fb3a89d390b None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.313136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0bc73-cac7-4bd6-85c9-2fb3a89d390b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:06.313247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0bc73-cac7-4bd6-85c9-2fb3a89d390b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:06.314617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0bc73-cac7-4bd6-85c9-2fb3a89d390b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:06.315901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:06.327486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 465/935] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:06.327486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434ed2-a047-4657-8010-b944f84194f0 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.327486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434ed2-a047-4657-8010-b944f84194f0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.327486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434ed2-a047-4657-8010-b944f84194f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.348158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-95434ed2-a047-4657-8010-b944f84194f0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:06.349503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-95434ed2-a047-4657-8010-b944f84194f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:06.364428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bc84b-9590-49ae-933e-35434c4bd85f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:06.406002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c247ad-eef2-41cc-98ea-b1a04a41b094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:06.406606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c247ad-eef2-41cc-98ea-b1a04a41b094 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.406881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c247ad-eef2-41cc-98ea-b1a04a41b094 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.407149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c247ad-eef2-41cc-98ea-b1a04a41b094 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.407834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c247ad-eef2-41cc-98ea-b1a04a41b094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:06.408136 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c247ad-eef2-41cc-98ea-b1a04a41b094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:06.409661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c247ad-eef2-41cc-98ea-b1a04a41b094 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:06.429593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 471/936] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:06.430720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c247ad-eef2-41cc-98ea-b1a04a41b094 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:06.431578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 466/937] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:06.436163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434ed2-a047-4657-8010-b944f84194f0 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:06.520451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:06.554353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434ed2-a047-4657-8010-b944f84194f0 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:06.555021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c247ad-eef2-41cc-98ea-b1a04a41b094 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:06.585482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:06.595008 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e86e3-33f6-4d4f-b878-43dfde2a6fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:06.595661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e86e3-33f6-4d4f-b878-43dfde2a6fd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.595936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e86e3-33f6-4d4f-b878-43dfde2a6fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.596204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e86e3-33f6-4d4f-b878-43dfde2a6fd5 None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/6c806e8c13414c38ad398069bfa2f03b/roles/b6c2fce401ec4816aae2928181962c37` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.598418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e86e3-33f6-4d4f-b878-43dfde2a6fd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=6c806e8c13414c38ad398069bfa2f03b, role_id=b6c2fce401ec4816aae2928181962c37)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:06.598770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b092c-4169-4eda-aebf-5c3004b7eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:06.599591 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b092c-4169-4eda-aebf-5c3004b7eef4 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.599846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e86e3-33f6-4d4f-b878-43dfde2a6fd5 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:06.600298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b092c-4169-4eda-aebf-5c3004b7eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.600812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b092c-4169-4eda-aebf-5c3004b7eef4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.601717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b092c-4169-4eda-aebf-5c3004b7eef4 None admin] RBAC: Adding query filter params (interface=public, service_id=d3e9ce598ed8408a94364cb8785d7432, region_id=RegionOne) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:06.602413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b092c-4169-4eda-aebf-5c3004b7eef4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:06.604802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b092c-4169-4eda-aebf-5c3004b7eef4 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:06.611660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 472/938] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:06 2022] GET /identity/v3/endpoints?service_id=d3e9ce598ed8408a94364cb8785d7432&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:06.614956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 467/939] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:06 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/6c806e8c13414c38ad398069bfa2f03b/roles/b6c2fce401ec4816aae2928181962c37 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:10:06.628829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e86e3-33f6-4d4f-b878-43dfde2a6fd5 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:06.629073 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b092c-4169-4eda-aebf-5c3004b7eef4 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:06.749339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b092c-4169-4eda-aebf-5c3004b7eef4 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:06.755080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e86e3-33f6-4d4f-b878-43dfde2a6fd5 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:06.787563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:06.793594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc242d-e027-4137-b239-1f4cf4296f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:06.794317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc242d-e027-4137-b239-1f4cf4296f59 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.794761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc242d-e027-4137-b239-1f4cf4296f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.795041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc242d-e027-4137-b239-1f4cf4296f59 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.795225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec81cd3-ab40-4432-9c56-e80eddc10653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:06.795651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc242d-e027-4137-b239-1f4cf4296f59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:06.796645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81cd3-ab40-4432-9c56-e80eddc10653 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.797076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc242d-e027-4137-b239-1f4cf4296f59 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:06.797238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81cd3-ab40-4432-9c56-e80eddc10653 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.797647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81cd3-ab40-4432-9c56-e80eddc10653 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.798497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec81cd3-ab40-4432-9c56-e80eddc10653 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:06.800447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec81cd3-ab40-4432-9c56-e80eddc10653 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:06.805179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 468/940] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:06 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-bec81cd3-ab40-4432-9c56-e80eddc10653 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:06.811903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:06.813219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:06.814393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:06.816748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 473/941] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Aug 9 12:10:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:06.823153 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc242d-e027-4137-b239-1f4cf4296f59 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:06.890194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:06.948889 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc242d-e027-4137-b239-1f4cf4296f59 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:06.987700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dc3e5-0f26-4bf3-b01b-e5a19d9a771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:06.988315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dc3e5-0f26-4bf3-b01b-e5a19d9a771d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.988592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dc3e5-0f26-4bf3-b01b-e5a19d9a771d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.988897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dc3e5-0f26-4bf3-b01b-e5a19d9a771d None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.989523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dc3e5-0f26-4bf3-b01b-e5a19d9a771d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:06.989823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dc3e5-0f26-4bf3-b01b-e5a19d9a771d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:06.991194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dc3e5-0f26-4bf3-b01b-e5a19d9a771d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:06.996525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 469/942] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:07.002722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec81cd3-ab40-4432-9c56-e80eddc10653 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.123867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec81cd3-ab40-4432-9c56-e80eddc10653 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:07.160088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2044284-ed15-4b93-8cab-492abbac35fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:07.160720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2044284-ed15-4b93-8cab-492abbac35fb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.161122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2044284-ed15-4b93-8cab-492abbac35fb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.161397 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2044284-ed15-4b93-8cab-492abbac35fb None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.162080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2044284-ed15-4b93-8cab-492abbac35fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:07.162380 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2044284-ed15-4b93-8cab-492abbac35fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:07.163734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2044284-ed15-4b93-8cab-492abbac35fb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:07.169192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 474/943] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:07.175819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dc3e5-0f26-4bf3-b01b-e5a19d9a771d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.284165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dc3e5-0f26-4bf3-b01b-e5a19d9a771d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:07.302124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:07.322691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec2398-37f4-4c73-8bef-815fe947f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:07.323302 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec2398-37f4-4c73-8bef-815fe947f1ac None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.323578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec2398-37f4-4c73-8bef-815fe947f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.323848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec2398-37f4-4c73-8bef-815fe947f1ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.324515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec2398-37f4-4c73-8bef-815fe947f1ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:07.326480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec2398-37f4-4c73-8bef-815fe947f1ac None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:07.354803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 470/944] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:07.422802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f7dac-339b-4d28-982b-0b6e04aa97f3 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.423312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f7dac-339b-4d28-982b-0b6e04aa97f3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.423312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f7dac-339b-4d28-982b-0b6e04aa97f3 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.425333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 475/945] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:07.431112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b0ef-ec94-49b8-8bd2-aed1ec3da5a2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.431392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b0ef-ec94-49b8-8bd2-aed1ec3da5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.431664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b0ef-ec94-49b8-8bd2-aed1ec3da5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.452737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-b0e6b0ef-ec94-49b8-8bd2-aed1ec3da5a2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:07.453952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b0e6b0ef-ec94-49b8-8bd2-aed1ec3da5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:07.538188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 471/946] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:07.560865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f7dac-339b-4d28-982b-0b6e04aa97f3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.624533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:07.667042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f7dac-339b-4d28-982b-0b6e04aa97f3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:07.702045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:07.702571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.702844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.703111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.703793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:07.705286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:07.707915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: WARNING keystone.server.flask.common [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 12:10:07.727416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.sql.core [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 12:10:07.727416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 12:10:07.727416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [parameters: {'id': 'cb0a8d48d43a427caf810b0da1398a78', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 12:10:07.727416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb0a8d48d43a427caf810b0da1398a78.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb0a8d48d43a427caf810b0da1398a78. Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:10:07.735291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application result.read() Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 09 12:10:07.736105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application yield resource Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise self.value Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application session.commit() Aug 09 12:10:07.737090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.session.flush() Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application compat.raise_( Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 12:10:07.737989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 12:10:07.738887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application result.read() Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:10:07.739680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [parameters: {'id': 'cb0a8d48d43a427caf810b0da1398a78', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:07.740539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:07.743377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:07.745277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:07.745277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 09 12:10:07.745277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 09 12:10:07.745277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:07.745277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:07.745277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 09 12:10:07.745277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 09 12:10:07.745277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb0a8d48d43a427caf810b0da1398a78. Aug 09 12:10:07.745277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:07.745277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 476/947] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Aug 9 12:10:07 2022] POST /identity/v3/projects => generated 262 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:07.745879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6b0ef-ec94-49b8-8bd2-aed1ec3da5a2 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.844433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:07.849180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6b0ef-ec94-49b8-8bd2-aed1ec3da5a2 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:07.887027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d882ee-5e26-4de6-b882-8bee67291be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:07.887838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d882ee-5e26-4de6-b882-8bee67291be8 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.888259 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d882ee-5e26-4de6-b882-8bee67291be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.888647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d882ee-5e26-4de6-b882-8bee67291be8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.896682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d882ee-5e26-4de6-b882-8bee67291be8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:07.898264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d882ee-5e26-4de6-b882-8bee67291be8 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-63d882ee-5e26-4de6-b882-8bee67291be8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:07.909948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:07.911056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:07.912107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:07.912107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:07.912107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:07.912107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:07.912107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:07.912107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:07.912107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:07.912107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:07.912107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 472/948] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:07.918026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.024131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2b14-b2c9-4d9b-8044-1963cdb3e5e3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.040572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:08.064590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3a36d-ad26-4bfe-8c1d-7cb9ab4547f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.065371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a36d-ad26-4bfe-8c1d-7cb9ab4547f1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.065750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a36d-ad26-4bfe-8c1d-7cb9ab4547f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.066117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a36d-ad26-4bfe-8c1d-7cb9ab4547f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.066890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3a36d-ad26-4bfe-8c1d-7cb9ab4547f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:08.067289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3a36d-ad26-4bfe-8c1d-7cb9ab4547f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.069061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3a36d-ad26-4bfe-8c1d-7cb9ab4547f1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.092618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 477/949] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:08.832857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad417e6-9d43-455d-a123-142ca25c81a2 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.833388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad417e6-9d43-455d-a123-142ca25c81a2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.833388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad417e6-9d43-455d-a123-142ca25c81a2 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.834925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 473/950] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:08.840176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9ec94-1478-4ad7-bd27-679fea2c43ed None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.840605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9ec94-1478-4ad7-bd27-679fea2c43ed None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.840818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9ec94-1478-4ad7-bd27-679fea2c43ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.860168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-48a9ec94-1478-4ad7-bd27-679fea2c43ed None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:08.861705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-48a9ec94-1478-4ad7-bd27-679fea2c43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:08.937787 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 478/951] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:08.943177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058fd2-e262-4087-bac5-364e4e98de76 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.943461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058fd2-e262-4087-bac5-364e4e98de76 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.943731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058fd2-e262-4087-bac5-364e4e98de76 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.945376 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 474/952] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:08.950420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab68d1-21a0-4c26-818a-950c8a44a31b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.951330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab68d1-21a0-4c26-818a-950c8a44a31b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.951581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab68d1-21a0-4c26-818a-950c8a44a31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.960776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058fd2-e262-4087-bac5-364e4e98de76 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.970401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-65ab68d1-21a0-4c26-818a-950c8a44a31b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:08.971687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-65ab68d1-21a0-4c26-818a-950c8a44a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:09.049150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 479/953] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:09.068946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab68d1-21a0-4c26-818a-950c8a44a31b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.070229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058fd2-e262-4087-bac5-364e4e98de76 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.107736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.109378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4604a9-2209-46ba-8f01-6d26dbd20596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.110015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4604a9-2209-46ba-8f01-6d26dbd20596 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.110293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4604a9-2209-46ba-8f01-6d26dbd20596 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.110562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4604a9-2209-46ba-8f01-6d26dbd20596 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.123256 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4604a9-2209-46ba-8f01-6d26dbd20596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-1d4604a9-2209-46ba-8f01-6d26dbd20596 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:09.128356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:09.129344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:09.130172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 475/954] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:09.137331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4604a9-2209-46ba-8f01-6d26dbd20596 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.160890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.190452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab68d1-21a0-4c26-818a-950c8a44a31b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.239210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af778f-f0ac-4d7c-8b0e-c13f374b0d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.239957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af778f-f0ac-4d7c-8b0e-c13f374b0d22 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.240302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af778f-f0ac-4d7c-8b0e-c13f374b0d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.240691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af778f-f0ac-4d7c-8b0e-c13f374b0d22 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.241356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af778f-f0ac-4d7c-8b0e-c13f374b0d22 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.243742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af778f-f0ac-4d7c-8b0e-c13f374b0d22 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-56af778f-f0ac-4d7c-8b0e-c13f374b0d22 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:09.256258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:09.257448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:09.258343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 480/955] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:09.265586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af778f-f0ac-4d7c-8b0e-c13f374b0d22 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.273271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4604a9-2209-46ba-8f01-6d26dbd20596 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.323973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d580674-d111-4bb7-9660-22adcd938745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.324581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580674-d111-4bb7-9660-22adcd938745 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.324891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580674-d111-4bb7-9660-22adcd938745 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.325161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580674-d111-4bb7-9660-22adcd938745 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.326366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d580674-d111-4bb7-9660-22adcd938745 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:09.326669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d580674-d111-4bb7-9660-22adcd938745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.328591 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d580674-d111-4bb7-9660-22adcd938745 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.340287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 476/956] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:09.346807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d580674-d111-4bb7-9660-22adcd938745 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.381963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.385667 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af778f-f0ac-4d7c-8b0e-c13f374b0d22 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.430036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9a47e-9ccb-4135-8b12-feb2ff340131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.430954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a47e-9ccb-4135-8b12-feb2ff340131 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.431454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a47e-9ccb-4135-8b12-feb2ff340131 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.431940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9a47e-9ccb-4135-8b12-feb2ff340131 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.432838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9a47e-9ccb-4135-8b12-feb2ff340131 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:09.433843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9a47e-9ccb-4135-8b12-feb2ff340131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.436087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9a47e-9ccb-4135-8b12-feb2ff340131 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.439968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.445199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 481/957] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:09.451038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9a47e-9ccb-4135-8b12-feb2ff340131 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.466654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d580674-d111-4bb7-9660-22adcd938745 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.505052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c163d1f-fc9c-4741-beae-cf90ef7509db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.505685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c163d1f-fc9c-4741-beae-cf90ef7509db None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.505963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c163d1f-fc9c-4741-beae-cf90ef7509db None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.506233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c163d1f-fc9c-4741-beae-cf90ef7509db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.518229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c163d1f-fc9c-4741-beae-cf90ef7509db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.519680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c163d1f-fc9c-4741-beae-cf90ef7509db None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-0c163d1f-fc9c-4741-beae-cf90ef7509db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:09.536981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:09.537986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:09.538964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:09.538964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:09.538964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:09.542616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 477/958] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:09.543744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f54b-fd8d-4272-8d49-5eb068eb6e72 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.544032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f54b-fd8d-4272-8d49-5eb068eb6e72 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.544924 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f54b-fd8d-4272-8d49-5eb068eb6e72 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.546558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 478/959] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:09.547279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58f54b-fd8d-4272-8d49-5eb068eb6e72 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.580506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9a47e-9ccb-4135-8b12-feb2ff340131 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.618294 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0981c0-a40d-4155-b7a3-17b3b3ecdb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.619223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0981c0-a40d-4155-b7a3-17b3b3ecdb67 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.619781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0981c0-a40d-4155-b7a3-17b3b3ecdb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.620062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0981c0-a40d-4155-b7a3-17b3b3ecdb67 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.620736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0981c0-a40d-4155-b7a3-17b3b3ecdb67 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:09.621042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0981c0-a40d-4155-b7a3-17b3b3ecdb67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.622621 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0981c0-a40d-4155-b7a3-17b3b3ecdb67 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.629389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 482/960] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:09.633685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56b869-7f91-41d8-abb9-43f11aa290e9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.633961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56b869-7f91-41d8-abb9-43f11aa290e9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.634578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56b869-7f91-41d8-abb9-43f11aa290e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.652296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7f56b869-7f91-41d8-abb9-43f11aa290e9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:09.653495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7f56b869-7f91-41d8-abb9-43f11aa290e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:09.662015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58f54b-fd8d-4272-8d49-5eb068eb6e72 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.678365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.694502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.699787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142f48e-9673-4fb3-8403-c36de91e2b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.700911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f48e-9673-4fb3-8403-c36de91e2b3b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.701333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f48e-9673-4fb3-8403-c36de91e2b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.701602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f48e-9673-4fb3-8403-c36de91e2b3b None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.702235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142f48e-9673-4fb3-8403-c36de91e2b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:09.702532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142f48e-9673-4fb3-8403-c36de91e2b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.703893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142f48e-9673-4fb3-8403-c36de91e2b3b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.715579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 479/961] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:09.717343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142f48e-9673-4fb3-8403-c36de91e2b3b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.735141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 483/962] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:09.736212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56b869-7f91-41d8-abb9-43f11aa290e9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.832491 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142f48e-9673-4fb3-8403-c36de91e2b3b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.848554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56b869-7f91-41d8-abb9-43f11aa290e9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.868678 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62c8d-3b7c-4b3b-bcf1-9cd66203590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.869321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62c8d-3b7c-4b3b-bcf1-9cd66203590e None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.869548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62c8d-3b7c-4b3b-bcf1-9cd66203590e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.869808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62c8d-3b7c-4b3b-bcf1-9cd66203590e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.870451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b62c8d-3b7c-4b3b-bcf1-9cd66203590e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.871804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b62c8d-3b7c-4b3b-bcf1-9cd66203590e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.885691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2205a7c-373a-47bd-96f3-aa432a7d3a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.886510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2205a7c-373a-47bd-96f3-aa432a7d3a8e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.886794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2205a7c-373a-47bd-96f3-aa432a7d3a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.887069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2205a7c-373a-47bd-96f3-aa432a7d3a8e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.900664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 480/963] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:09.900664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62c8d-3b7c-4b3b-bcf1-9cd66203590e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.904896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2205a7c-373a-47bd-96f3-aa432a7d3a8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.906526 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2205a7c-373a-47bd-96f3-aa432a7d3a8e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e2205a7c-373a-47bd-96f3-aa432a7d3a8e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:09.920405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:09.921590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:09.922864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 484/964] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:09.929663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2205a7c-373a-47bd-96f3-aa432a7d3a8e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.959240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.964365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.046681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62c8d-3b7c-4b3b-bcf1-9cd66203590e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.068574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2205a7c-373a-47bd-96f3-aa432a7d3a8e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.086382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183feec-aac0-4350-ade3-8baf6f6a7fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.087011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183feec-aac0-4350-ade3-8baf6f6a7fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.087286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183feec-aac0-4350-ade3-8baf6f6a7fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.087554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183feec-aac0-4350-ade3-8baf6f6a7fd2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.088155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183feec-aac0-4350-ade3-8baf6f6a7fd2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.090317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183feec-aac0-4350-ade3-8baf6f6a7fd2 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-3183feec-aac0-4350-ade3-8baf6f6a7fd2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:10.099930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:10.101096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:10.102411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 481/965] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:10.111404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183feec-aac0-4350-ade3-8baf6f6a7fd2 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.114986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94557fb-7e4a-4901-84df-55f8e99ea511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.115652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94557fb-7e4a-4901-84df-55f8e99ea511 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.115930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94557fb-7e4a-4901-84df-55f8e99ea511 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.116192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94557fb-7e4a-4901-84df-55f8e99ea511 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.116958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94557fb-7e4a-4901-84df-55f8e99ea511 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:10.117259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94557fb-7e4a-4901-84df-55f8e99ea511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.118685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94557fb-7e4a-4901-84df-55f8e99ea511 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.143708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 485/966] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:10.149171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94557fb-7e4a-4901-84df-55f8e99ea511 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.235348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183feec-aac0-4350-ade3-8baf6f6a7fd2 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.245536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.246712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.274163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94557fb-7e4a-4901-84df-55f8e99ea511 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.274614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dace6c-c5d0-4a30-bb0d-121055a54af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.275313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dace6c-c5d0-4a30-bb0d-121055a54af3 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.275685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dace6c-c5d0-4a30-bb0d-121055a54af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.276040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dace6c-c5d0-4a30-bb0d-121055a54af3 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.276831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dace6c-c5d0-4a30-bb0d-121055a54af3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:10.277226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dace6c-c5d0-4a30-bb0d-121055a54af3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.279348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dace6c-c5d0-4a30-bb0d-121055a54af3 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.284684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 482/967] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:10.286478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded4879-50ad-4dc1-888a-bf2f6e1e3287 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.286769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded4879-50ad-4dc1-888a-bf2f6e1e3287 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.287038 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded4879-50ad-4dc1-888a-bf2f6e1e3287 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.288231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 483/968] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:10.292859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded4879-50ad-4dc1-888a-bf2f6e1e3287 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.315684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e1e5f-1869-427c-be05-6ec7b3401e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.316290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1e5f-1869-427c-be05-6ec7b3401e40 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.316573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1e5f-1869-427c-be05-6ec7b3401e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.316861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1e5f-1869-427c-be05-6ec7b3401e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.390804 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e1e5f-1869-427c-be05-6ec7b3401e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.392395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e1e5f-1869-427c-be05-6ec7b3401e40 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.404809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded4879-50ad-4dc1-888a-bf2f6e1e3287 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.444898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1081a73-e756-4f3a-b0f8-8163b9736bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.445501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1081a73-e756-4f3a-b0f8-8163b9736bec None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.445779 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1081a73-e756-4f3a-b0f8-8163b9736bec None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.446045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1081a73-e756-4f3a-b0f8-8163b9736bec None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.446692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1081a73-e756-4f3a-b0f8-8163b9736bec None admin] RBAC: Adding query filter params (type=compute) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:10.446991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1081a73-e756-4f3a-b0f8-8163b9736bec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.448356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1081a73-e756-4f3a-b0f8-8163b9736bec None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.456538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 484/969] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:10.456538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cec1a-547c-4526-9cfe-db93b7f3211c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.456538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cec1a-547c-4526-9cfe-db93b7f3211c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.456538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cec1a-547c-4526-9cfe-db93b7f3211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.477444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ee3cec1a-547c-4526-9cfe-db93b7f3211c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:10.478774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ee3cec1a-547c-4526-9cfe-db93b7f3211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:10.490550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.518205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.521394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 486/970] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 12:10:10.527630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e1e5f-1869-427c-be05-6ec7b3401e40 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.585902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 485/971] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:10.610395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cec1a-547c-4526-9cfe-db93b7f3211c None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.646431 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e1e5f-1869-427c-be05-6ec7b3401e40 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.683977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600f6e5-5976-4eef-b1f8-63edbe3e2e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.685272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600f6e5-5976-4eef-b1f8-63edbe3e2e1f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.685780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600f6e5-5976-4eef-b1f8-63edbe3e2e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.686195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600f6e5-5976-4eef-b1f8-63edbe3e2e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.697214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600f6e5-5976-4eef-b1f8-63edbe3e2e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.698808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600f6e5-5976-4eef-b1f8-63edbe3e2e1f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7600f6e5-5976-4eef-b1f8-63edbe3e2e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:10.716686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:10.717905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:10.718999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:10.718999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:10.718999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:10.720305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 487/972] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:10.726596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600f6e5-5976-4eef-b1f8-63edbe3e2e1f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.743761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cec1a-547c-4526-9cfe-db93b7f3211c None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.759982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.783931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.784543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.784860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.785115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.785762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.787207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.790009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WARNING keystone.server.flask.common [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 12:10:10.803949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.sql.core [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 12:10:10.803949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 12:10:10.803949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [parameters: {'user_id': '908f4bf0bc9f47db82b8fadc7f983ccc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 12:10:10.803949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80086) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application result.read() Aug 09 12:10:10.820545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:10:10.821617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application yield resource Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise self.value Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application session.commit() Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 12:10:10.822589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self.session.flush() Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application compat.raise_( Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 12:10:10.823474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:10:10.826088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application result.read() Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:10:10.828372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [parameters: {'user_id': '908f4bf0bc9f47db82b8fadc7f983ccc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:10.830444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 09 12:10:10.832395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 09 12:10:10.835047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 09 12:10:10.835047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 09 12:10:10.835047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 12:10:10.835047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 12:10:10.835047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 12:10:10.835047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:10.835047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 486/973] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Aug 9 12:10:10 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:10.835047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.861503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600f6e5-5976-4eef-b1f8-63edbe3e2e1f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.876315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.899890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5fd25-e140-450c-985e-7a72238110c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.900566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5fd25-e140-450c-985e-7a72238110c6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.901102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5fd25-e140-450c-985e-7a72238110c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.901267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5fd25-e140-450c-985e-7a72238110c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.901838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5fd25-e140-450c-985e-7a72238110c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:10.902136 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5fd25-e140-450c-985e-7a72238110c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.903521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5fd25-e140-450c-985e-7a72238110c6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.917733 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 488/974] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:10.923316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5fd25-e140-450c-985e-7a72238110c6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.972199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860569-d18a-47af-a162-d7b959b20b07 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.018223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec497ae1-a62f-406f-a951-093cfd2211a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.018861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497ae1-a62f-406f-a951-093cfd2211a6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.019141 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497ae1-a62f-406f-a951-093cfd2211a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.019410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497ae1-a62f-406f-a951-093cfd2211a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.029242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec497ae1-a62f-406f-a951-093cfd2211a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.031659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec497ae1-a62f-406f-a951-093cfd2211a6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.038346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-ec497ae1-a62f-406f-a951-093cfd2211a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:11.051698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:11.052892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:11.054058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:11.054058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:11.054058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:11.054058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:11.054058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:11.054058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:11.054058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:11.054058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:11.054058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:10:11.054058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:11.055788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5fd25-e140-450c-985e-7a72238110c6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.056322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 487/975] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:11.061942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec497ae1-a62f-406f-a951-093cfd2211a6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:11.110096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73a6d-1dae-4ee8-9a0b-811e80adcf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.110826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73a6d-1dae-4ee8-9a0b-811e80adcf37 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.111154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73a6d-1dae-4ee8-9a0b-811e80adcf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.111468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73a6d-1dae-4ee8-9a0b-811e80adcf37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.120728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73a6d-1dae-4ee8-9a0b-811e80adcf37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.122241 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73a6d-1dae-4ee8-9a0b-811e80adcf37 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-4ac73a6d-1dae-4ee8-9a0b-811e80adcf37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:11.141250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:11.142354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:11.143416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:11.143416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:11.143416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:11.143416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:11.143416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:11.143416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:11.143416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:11.143416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:11.146426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 489/976] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:11.152056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73a6d-1dae-4ee8-9a0b-811e80adcf37 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:11.185705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:11.202488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec497ae1-a62f-406f-a951-093cfd2211a6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.250483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172951-645e-4a1e-b3b8-dc85c763dab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.250999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172951-645e-4a1e-b3b8-dc85c763dab0 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.251275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172951-645e-4a1e-b3b8-dc85c763dab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.251538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172951-645e-4a1e-b3b8-dc85c763dab0 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.252755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e172951-645e-4a1e-b3b8-dc85c763dab0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:11.253060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e172951-645e-4a1e-b3b8-dc85c763dab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.254734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e172951-645e-4a1e-b3b8-dc85c763dab0 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.272332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73a6d-1dae-4ee8-9a0b-811e80adcf37 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.307261 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 488/977] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:11.321094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daea6b-d513-4d62-a136-0cb4c1a80b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.322129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daea6b-d513-4d62-a136-0cb4c1a80b64 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.322638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daea6b-d513-4d62-a136-0cb4c1a80b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.323114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daea6b-d513-4d62-a136-0cb4c1a80b64 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.324055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daea6b-d513-4d62-a136-0cb4c1a80b64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:11.324576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daea6b-d513-4d62-a136-0cb4c1a80b64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.326481 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daea6b-d513-4d62-a136-0cb4c1a80b64 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.345116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 490/978] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:11.348373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172951-645e-4a1e-b3b8-dc85c763dab0 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:11.461279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172951-645e-4a1e-b3b8-dc85c763dab0 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.499432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fda41-429c-4244-ae3c-c4878d3ac7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.500041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fda41-429c-4244-ae3c-c4878d3ac7fc None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.500314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fda41-429c-4244-ae3c-c4878d3ac7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.500649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fda41-429c-4244-ae3c-c4878d3ac7fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.501323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fda41-429c-4244-ae3c-c4878d3ac7fc None admin] RBAC: Adding query filter params (role.id=b6c2fce401ec4816aae2928181962c37, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=6c806e8c13414c38ad398069bfa2f03b) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:11.501628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fda41-429c-4244-ae3c-c4878d3ac7fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.503043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fda41-429c-4244-ae3c-c4878d3ac7fc None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.510025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 489/979] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/role_assignments?user.id=6c806e8c13414c38ad398069bfa2f03b&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=b6c2fce401ec4816aae2928181962c37 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:12.065455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1e70-3880-4ecf-9663-5859ffd5d9c1 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.066010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1e70-3880-4ecf-9663-5859ffd5d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.066010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1e70-3880-4ecf-9663-5859ffd5d9c1 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.067365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 491/980] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:12.072499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a23d74-639a-4df3-af11-52e4974d60e9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.072914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a23d74-639a-4df3-af11-52e4974d60e9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.073090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a23d74-639a-4df3-af11-52e4974d60e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.092344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-93a23d74-639a-4df3-af11-52e4974d60e9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:12.094185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-93a23d74-639a-4df3-af11-52e4974d60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:12.098486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:12.168663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 490/981] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:12.189316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df1e70-3880-4ecf-9663-5859ffd5d9c1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.201517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:12.296977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df1e70-3880-4ecf-9663-5859ffd5d9c1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:12.331244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d19b0-f33d-4e1c-9b05-411fc3e9cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.331923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d19b0-f33d-4e1c-9b05-411fc3e9cd68 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.332317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d19b0-f33d-4e1c-9b05-411fc3e9cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.332715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d19b0-f33d-4e1c-9b05-411fc3e9cd68 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.333394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d19b0-f33d-4e1c-9b05-411fc3e9cd68 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.334844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d19b0-f33d-4e1c-9b05-411fc3e9cd68 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7e5d19b0-f33d-4e1c-9b05-411fc3e9cd68 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:12.344124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:12.345297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:12.346412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:12.348153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 492/982] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:12.353900 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a23d74-639a-4df3-af11-52e4974d60e9 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.460023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a23d74-639a-4df3-af11-52e4974d60e9 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:12.494260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655bbba-fb2c-4b4e-a7b1-4a39fae8a5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.494864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bbba-fb2c-4b4e-a7b1-4a39fae8a5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.495140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bbba-fb2c-4b4e-a7b1-4a39fae8a5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.495411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655bbba-fb2c-4b4e-a7b1-4a39fae8a5f7 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.496210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655bbba-fb2c-4b4e-a7b1-4a39fae8a5f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:12.496516 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655bbba-fb2c-4b4e-a7b1-4a39fae8a5f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.497943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655bbba-fb2c-4b4e-a7b1-4a39fae8a5f7 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:12.507418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 491/983] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:12.508589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d19b0-f33d-4e1c-9b05-411fc3e9cd68 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.553214 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e423f7-2673-4ef3-ba82-105cdce6a2de None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.553577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e423f7-2673-4ef3-ba82-105cdce6a2de None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.553754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e423f7-2673-4ef3-ba82-105cdce6a2de None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.555392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 492/984] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:12.560036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b316da-01eb-4a81-b2c4-e31504cc92c0 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.560311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b316da-01eb-4a81-b2c4-e31504cc92c0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.560578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b316da-01eb-4a81-b2c4-e31504cc92c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.568488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:12.584149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d9b316da-01eb-4a81-b2c4-e31504cc92c0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:12.585306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d9b316da-01eb-4a81-b2c4-e31504cc92c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:12.586682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:12.619955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d19b0-f33d-4e1c-9b05-411fc3e9cd68 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:12.665169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99763fa9-fa5c-42ad-ac5a-ba3ace481c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.665763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99763fa9-fa5c-42ad-ac5a-ba3ace481c70 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.666000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99763fa9-fa5c-42ad-ac5a-ba3ace481c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.666239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99763fa9-fa5c-42ad-ac5a-ba3ace481c70 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.666424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 493/985] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:12.666867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99763fa9-fa5c-42ad-ac5a-ba3ace481c70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:12.667162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99763fa9-fa5c-42ad-ac5a-ba3ace481c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.668634 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99763fa9-fa5c-42ad-ac5a-ba3ace481c70 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:12.676982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 493/986] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:12.682671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b316da-01eb-4a81-b2c4-e31504cc92c0 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.690580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99763fa9-fa5c-42ad-ac5a-ba3ace481c70 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.788902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b316da-01eb-4a81-b2c4-e31504cc92c0 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:12.793923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99763fa9-fa5c-42ad-ac5a-ba3ace481c70 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:12.827248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b026f59-03b9-45ab-b974-c8ddfc271d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.827855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b026f59-03b9-45ab-b974-c8ddfc271d66 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.828119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b026f59-03b9-45ab-b974-c8ddfc271d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.828382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b026f59-03b9-45ab-b974-c8ddfc271d66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.829101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b026f59-03b9-45ab-b974-c8ddfc271d66 None admin] RBAC: Adding query filter params (interface=admin, service_id=d3e9ce598ed8408a94364cb8785d7432, region_id=RegionOne) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:12.829399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b026f59-03b9-45ab-b974-c8ddfc271d66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.830751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b026f59-03b9-45ab-b974-c8ddfc271d66 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:12.831651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc85aa7-d028-4b52-ab00-09d00da37bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.832260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc85aa7-d028-4b52-ab00-09d00da37bd3 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.832404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:12.832550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc85aa7-d028-4b52-ab00-09d00da37bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.832873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc85aa7-d028-4b52-ab00-09d00da37bd3 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.833589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc85aa7-d028-4b52-ab00-09d00da37bd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.835113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc85aa7-d028-4b52-ab00-09d00da37bd3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:12.842521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 494/987] 10.222.0.25 () {56 vars in 1249 bytes} [Tue Aug 9 12:10:12 2022] GET /identity/v3/endpoints?service_id=d3e9ce598ed8408a94364cb8785d7432&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:12.843503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:12.843627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b026f59-03b9-45ab-b974-c8ddfc271d66 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.865681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 494/988] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:12 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:12.964495 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b026f59-03b9-45ab-b974-c8ddfc271d66 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:13.010753 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85fbc3-6c7a-4a5b-a015-7a58521e6ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:13.011360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85fbc3-6c7a-4a5b-a015-7a58521e6ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:13.011639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85fbc3-6c7a-4a5b-a015-7a58521e6ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:13.011986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85fbc3-6c7a-4a5b-a015-7a58521e6ea1 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:13.012584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85fbc3-6c7a-4a5b-a015-7a58521e6ea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:13.014010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85fbc3-6c7a-4a5b-a015-7a58521e6ea1 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:13.020681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 495/989] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:12 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:10:13.560162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732a5c3-a9bc-4313-b6a9-05218839d16c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:13.560745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732a5c3-a9bc-4313-b6a9-05218839d16c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:13.560836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732a5c3-a9bc-4313-b6a9-05218839d16c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:13.562355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 495/990] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:13.567388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee97ec6-badb-4b4b-a81f-27d92f816051 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:13.567821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee97ec6-badb-4b4b-a81f-27d92f816051 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:13.568007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee97ec6-badb-4b4b-a81f-27d92f816051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:13.585762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-6ee97ec6-badb-4b4b-a81f-27d92f816051 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:13.586925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-6ee97ec6-badb-4b4b-a81f-27d92f816051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:13.639495 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:13.654702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 496/991] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:13.676617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732a5c3-a9bc-4313-b6a9-05218839d16c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:13.780702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732a5c3-a9bc-4313-b6a9-05218839d16c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:13.815323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe2f47-5e15-4ced-97de-3f70cd56c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:13.815944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe2f47-5e15-4ced-97de-3f70cd56c4ea None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:13.816221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe2f47-5e15-4ced-97de-3f70cd56c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:13.816491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe2f47-5e15-4ced-97de-3f70cd56c4ea None admin] PATH_INFO: `/v3/services/image` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:13.817096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe2f47-5e15-4ced-97de-3f70cd56c4ea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:13.818446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe2f47-5e15-4ced-97de-3f70cd56c4ea None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-7bfe2f47-5e15-4ced-97de-3f70cd56c4ea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:13.827036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:13.827993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:13.829468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 496/992] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Aug 9 12:10:13 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:13.834027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee97ec6-badb-4b4b-a81f-27d92f816051 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:13.932189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee97ec6-badb-4b4b-a81f-27d92f816051 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:13.966707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3600694-bf51-4937-876d-f00a3f0298fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:13.967396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3600694-bf51-4937-876d-f00a3f0298fc None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:13.967672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3600694-bf51-4937-876d-f00a3f0298fc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:13.967935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3600694-bf51-4937-876d-f00a3f0298fc None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:13.968557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3600694-bf51-4937-876d-f00a3f0298fc None admin] RBAC: Adding query filter params (name=image) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:13.968897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3600694-bf51-4937-876d-f00a3f0298fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:13.970263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3600694-bf51-4937-876d-f00a3f0298fc None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:13.979968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 497/993] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:13.982283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe2f47-5e15-4ced-97de-3f70cd56c4ea None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:14.043196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:14.086015 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe2f47-5e15-4ced-97de-3f70cd56c4ea None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:14.120859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8b829-f1cf-4781-bda2-c7a7e9959785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:14.121481 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8b829-f1cf-4781-bda2-c7a7e9959785 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.121759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8b829-f1cf-4781-bda2-c7a7e9959785 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.122028 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8b829-f1cf-4781-bda2-c7a7e9959785 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.122711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8b829-f1cf-4781-bda2-c7a7e9959785 None admin] RBAC: Adding query filter params (type=image) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:14.123012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8b829-f1cf-4781-bda2-c7a7e9959785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:14.124416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8b829-f1cf-4781-bda2-c7a7e9959785 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:14.136661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 497/994] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:14.898222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b0f6-3664-4aaf-b981-3c37013d7228 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.898772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b0f6-3664-4aaf-b981-3c37013d7228 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.898772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b0f6-3664-4aaf-b981-3c37013d7228 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.900249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 498/995] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:14.905238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7efae-4c6d-4ab2-97f3-8d34d74e5cb6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.905651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7efae-4c6d-4ab2-97f3-8d34d74e5cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.905827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7efae-4c6d-4ab2-97f3-8d34d74e5cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.924550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9fa7efae-4c6d-4ab2-97f3-8d34d74e5cb6 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:14.925768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9fa7efae-4c6d-4ab2-97f3-8d34d74e5cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:14.991885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 498/996] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:15.015132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b0f6-3664-4aaf-b981-3c37013d7228 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.028608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff606dad-dde3-4982-b781-1686115dbdd4 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.028924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff606dad-dde3-4982-b781-1686115dbdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.029197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff606dad-dde3-4982-b781-1686115dbdd4 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.030558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 499/997] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:15.035288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eb560-d95f-43ba-aa17-d552c31c5bd9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.035568 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eb560-d95f-43ba-aa17-d552c31c5bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.035839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eb560-d95f-43ba-aa17-d552c31c5bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.053738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-794eb560-d95f-43ba-aa17-d552c31c5bd9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:15.054912 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-794eb560-d95f-43ba-aa17-d552c31c5bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:15.071595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.115067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.131319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b0f6-3664-4aaf-b981-3c37013d7228 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.136682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 500/998] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:15.156601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794eb560-d95f-43ba-aa17-d552c31c5bd9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.170393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3057ff3-f968-4c81-ab15-8e0023199994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.171018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3057ff3-f968-4c81-ab15-8e0023199994 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.171534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3057ff3-f968-4c81-ab15-8e0023199994 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.171534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3057ff3-f968-4c81-ab15-8e0023199994 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.172108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3057ff3-f968-4c81-ab15-8e0023199994 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.173509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3057ff3-f968-4c81-ab15-8e0023199994 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-b3057ff3-f968-4c81-ab15-8e0023199994 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:15.182467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:15.183452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:15.184304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 499/999] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:15.189933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3057ff3-f968-4c81-ab15-8e0023199994 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.266809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794eb560-d95f-43ba-aa17-d552c31c5bd9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.304638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3057ff3-f968-4c81-ab15-8e0023199994 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.304955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5c770-6345-433d-b9e4-8131fc3e4834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.305585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5c770-6345-433d-b9e4-8131fc3e4834 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.305860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5c770-6345-433d-b9e4-8131fc3e4834 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.306152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5c770-6345-433d-b9e4-8131fc3e4834 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.306698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5c770-6345-433d-b9e4-8131fc3e4834 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.308054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5c770-6345-433d-b9e4-8131fc3e4834 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-45f5c770-6345-433d-b9e4-8131fc3e4834 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:15.317042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:15.318049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:15.318952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 501/1000] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:15.323611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.323933 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5c770-6345-433d-b9e4-8131fc3e4834 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.344756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9f019-db68-42a5-87ba-83c8e52d3d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.345468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9f019-db68-42a5-87ba-83c8e52d3d0d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.345816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9f019-db68-42a5-87ba-83c8e52d3d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.346160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9f019-db68-42a5-87ba-83c8e52d3d0d None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.346853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9f019-db68-42a5-87ba-83c8e52d3d0d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.347229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9f019-db68-42a5-87ba-83c8e52d3d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.348685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9f019-db68-42a5-87ba-83c8e52d3d0d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.358458 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 500/1001] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:15.359423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9f019-db68-42a5-87ba-83c8e52d3d0d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.380605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.441710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5c770-6345-433d-b9e4-8131fc3e4834 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.471465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9f019-db68-42a5-87ba-83c8e52d3d0d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.476902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5070afa-87ee-4bcd-9acc-994e983d6398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.477742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5070afa-87ee-4bcd-9acc-994e983d6398 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.478259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5070afa-87ee-4bcd-9acc-994e983d6398 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.478589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5070afa-87ee-4bcd-9acc-994e983d6398 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.479219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5070afa-87ee-4bcd-9acc-994e983d6398 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.479519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5070afa-87ee-4bcd-9acc-994e983d6398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.480891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5070afa-87ee-4bcd-9acc-994e983d6398 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.487488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 502/1002] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:15.492704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5070afa-87ee-4bcd-9acc-994e983d6398 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.510261 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22455c-e616-4652-8d4c-7bb6f7e3e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.510869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22455c-e616-4652-8d4c-7bb6f7e3e17d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.511142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22455c-e616-4652-8d4c-7bb6f7e3e17d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.511412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22455c-e616-4652-8d4c-7bb6f7e3e17d None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.512027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22455c-e616-4652-8d4c-7bb6f7e3e17d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.512327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22455c-e616-4652-8d4c-7bb6f7e3e17d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.513892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22455c-e616-4652-8d4c-7bb6f7e3e17d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.523495 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 501/1003] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:15.524674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22455c-e616-4652-8d4c-7bb6f7e3e17d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.573742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.604436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5070afa-87ee-4bcd-9acc-994e983d6398 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.618995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.633348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22455c-e616-4652-8d4c-7bb6f7e3e17d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.646628 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29f18-cb82-4696-b578-46169e589124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.647399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29f18-cb82-4696-b578-46169e589124 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.647679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29f18-cb82-4696-b578-46169e589124 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.648313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29f18-cb82-4696-b578-46169e589124 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.649235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29f18-cb82-4696-b578-46169e589124 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.649540 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29f18-cb82-4696-b578-46169e589124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.651341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29f18-cb82-4696-b578-46169e589124 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.657278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 503/1004] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:15.662502 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29f18-cb82-4696-b578-46169e589124 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.675008 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664437f1-8300-4249-8c0e-09a2351b51da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.675855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664437f1-8300-4249-8c0e-09a2351b51da None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.676290 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664437f1-8300-4249-8c0e-09a2351b51da None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.676573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664437f1-8300-4249-8c0e-09a2351b51da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.677307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664437f1-8300-4249-8c0e-09a2351b51da None admin] RBAC: Adding query filter params (interface=public, service_id=f809887cfbc84d3081a848077c6d295e, region_id=RegionOne) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.677619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664437f1-8300-4249-8c0e-09a2351b51da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.678985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664437f1-8300-4249-8c0e-09a2351b51da None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.685100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 502/1005] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/endpoints?service_id=f809887cfbc84d3081a848077c6d295e&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:15.690748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664437f1-8300-4249-8c0e-09a2351b51da None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.774400 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29f18-cb82-4696-b578-46169e589124 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.800397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664437f1-8300-4249-8c0e-09a2351b51da None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.810231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.811108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559b6d9-8941-4c74-b694-227eb750385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.811751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b6d9-8941-4c74-b694-227eb750385a None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.812052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b6d9-8941-4c74-b694-227eb750385a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.812325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b6d9-8941-4c74-b694-227eb750385a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.813328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559b6d9-8941-4c74-b694-227eb750385a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.815014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559b6d9-8941-4c74-b694-227eb750385a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.834801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 504/1006] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:15.857642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b204395-aa48-4fb2-8434-71bcb7fd35ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.858306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b204395-aa48-4fb2-8434-71bcb7fd35ee None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.858577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b204395-aa48-4fb2-8434-71bcb7fd35ee None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.858884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b204395-aa48-4fb2-8434-71bcb7fd35ee None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.859647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b204395-aa48-4fb2-8434-71bcb7fd35ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.861225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b204395-aa48-4fb2-8434-71bcb7fd35ee None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.876676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 503/1007] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:10:16.147218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf35b0-787f-4f2b-9e1f-7eb17ae876be None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.147771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf35b0-787f-4f2b-9e1f-7eb17ae876be None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.147771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf35b0-787f-4f2b-9e1f-7eb17ae876be None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.149160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 505/1008] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:16.154477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954532a-033c-45a7-b850-b7198ea048c7 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.154869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954532a-033c-45a7-b850-b7198ea048c7 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.155029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954532a-033c-45a7-b850-b7198ea048c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.173280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-e954532a-033c-45a7-b850-b7198ea048c7 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:16.174709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e954532a-033c-45a7-b850-b7198ea048c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:16.244286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 504/1009] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:16 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:16.266994 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf35b0-787f-4f2b-9e1f-7eb17ae876be None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:16.304105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:16.374389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf35b0-787f-4f2b-9e1f-7eb17ae876be None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:16.409924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9479df-79d9-46c0-900e-9fd32202b540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:16.410453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9479df-79d9-46c0-900e-9fd32202b540 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.410730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9479df-79d9-46c0-900e-9fd32202b540 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.410999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9479df-79d9-46c0-900e-9fd32202b540 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.411651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9479df-79d9-46c0-900e-9fd32202b540 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:16.413034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9479df-79d9-46c0-900e-9fd32202b540 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:16.430177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 506/1010] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:16 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:17.871183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4831-0ebc-41cc-9b19-246b85350dbf None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.871687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4831-0ebc-41cc-9b19-246b85350dbf None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.871766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4831-0ebc-41cc-9b19-246b85350dbf None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.873193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 505/1011] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:17.878250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d622106-f86b-4e58-8f1e-511679ff21a7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.878641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d622106-f86b-4e58-8f1e-511679ff21a7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.878823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d622106-f86b-4e58-8f1e-511679ff21a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.896587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3d622106-f86b-4e58-8f1e-511679ff21a7 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:17.897859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3d622106-f86b-4e58-8f1e-511679ff21a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:17.924480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743ec3-979e-491a-9b1c-7522711b469b None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.924794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743ec3-979e-491a-9b1c-7522711b469b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.925069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743ec3-979e-491a-9b1c-7522711b469b None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.926669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 506/1012] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:17.931524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ba85-b203-4b92-857d-047c40c13ed6 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.932121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ba85-b203-4b92-857d-047c40c13ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.932398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ba85-b203-4b92-857d-047c40c13ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.950249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-f713ba85-b203-4b92-857d-047c40c13ed6 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:17.951505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f713ba85-b203-4b92-857d-047c40c13ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:17.979285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 507/1013] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:17 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:18.002576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d622106-f86b-4e58-8f1e-511679ff21a7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.026770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.027236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 507/1014] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:17 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:18.050389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713ba85-b203-4b92-857d-047c40c13ed6 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.079299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.108904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d622106-f86b-4e58-8f1e-511679ff21a7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.143299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df6c44-6883-4578-b00a-a0cbd28f4be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.143858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df6c44-6883-4578-b00a-a0cbd28f4be7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.144132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df6c44-6883-4578-b00a-a0cbd28f4be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.144403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df6c44-6883-4578-b00a-a0cbd28f4be7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.145544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df6c44-6883-4578-b00a-a0cbd28f4be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.146961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df6c44-6883-4578-b00a-a0cbd28f4be7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.148722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 508/1015] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:18.154891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df6c44-6883-4578-b00a-a0cbd28f4be7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.161584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713ba85-b203-4b92-857d-047c40c13ed6 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.197004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825df25-6f10-4977-b0a7-570bf459270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.197631 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825df25-6f10-4977-b0a7-570bf459270d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.197909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825df25-6f10-4977-b0a7-570bf459270d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.198181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825df25-6f10-4977-b0a7-570bf459270d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.198757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825df25-6f10-4977-b0a7-570bf459270d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.200136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825df25-6f10-4977-b0a7-570bf459270d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-c825df25-6f10-4977-b0a7-570bf459270d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:18.208830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:18.209835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:18.210698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 508/1016] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:18.216299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825df25-6f10-4977-b0a7-570bf459270d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.251663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.263321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df6c44-6883-4578-b00a-a0cbd28f4be7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.297786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d1161-d19a-4566-a93a-d1624dadd1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.298398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d1161-d19a-4566-a93a-d1624dadd1ec None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.298940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d1161-d19a-4566-a93a-d1624dadd1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.299209 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d1161-d19a-4566-a93a-d1624dadd1ec None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.299845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d1161-d19a-4566-a93a-d1624dadd1ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.301306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d1161-d19a-4566-a93a-d1624dadd1ec None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.315355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.325429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825df25-6f10-4977-b0a7-570bf459270d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.340666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 509/1017] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:18 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:18.373867 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8338406-31b0-41d6-bb3a-11bb9c1d639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.374603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8338406-31b0-41d6-bb3a-11bb9c1d639e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.374971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8338406-31b0-41d6-bb3a-11bb9c1d639e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.375313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8338406-31b0-41d6-bb3a-11bb9c1d639e None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.376027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8338406-31b0-41d6-bb3a-11bb9c1d639e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:18.376397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8338406-31b0-41d6-bb3a-11bb9c1d639e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.377978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8338406-31b0-41d6-bb3a-11bb9c1d639e None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.388663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 509/1018] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:18.390083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d1161-d19a-4566-a93a-d1624dadd1ec None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.439249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74a59-efa8-44ea-8eae-a440d2888d13 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.440155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74a59-efa8-44ea-8eae-a440d2888d13 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.440496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74a59-efa8-44ea-8eae-a440d2888d13 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.442553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 510/1019] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:18.448300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa309fa-80fa-4248-a834-65578c1f839b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.448897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa309fa-80fa-4248-a834-65578c1f839b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.449347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa309fa-80fa-4248-a834-65578c1f839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.469661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-1fa309fa-80fa-4248-a834-65578c1f839b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:18.470966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1fa309fa-80fa-4248-a834-65578c1f839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:18.511848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d1161-d19a-4566-a93a-d1624dadd1ec None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.549392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cc67a-1248-4225-8bf9-1d48eaea6d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.550005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cc67a-1248-4225-8bf9-1d48eaea6d9e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.550286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cc67a-1248-4225-8bf9-1d48eaea6d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.550560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cc67a-1248-4225-8bf9-1d48eaea6d9e None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.551156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 511/1020] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:18 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:18.551274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cc67a-1248-4225-8bf9-1d48eaea6d9e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:18.551480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cc67a-1248-4225-8bf9-1d48eaea6d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.553041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cc67a-1248-4225-8bf9-1d48eaea6d9e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.558488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 510/1021] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:18.564142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa309fa-80fa-4248-a834-65578c1f839b None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.573769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cc67a-1248-4225-8bf9-1d48eaea6d9e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.585680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.654058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.672593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa309fa-80fa-4248-a834-65578c1f839b None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.693167 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cc67a-1248-4225-8bf9-1d48eaea6d9e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.708583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2939370-9f0b-40b9-ba95-df780140c964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.709232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2939370-9f0b-40b9-ba95-df780140c964 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.709504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2939370-9f0b-40b9-ba95-df780140c964 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.709765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2939370-9f0b-40b9-ba95-df780140c964 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.710423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2939370-9f0b-40b9-ba95-df780140c964 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.711778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2939370-9f0b-40b9-ba95-df780140c964 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.729199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c51d2b-6489-4a1b-9f5b-875d8ae6f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.729828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51d2b-6489-4a1b-9f5b-875d8ae6f074 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.730104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51d2b-6489-4a1b-9f5b-875d8ae6f074 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.730370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51d2b-6489-4a1b-9f5b-875d8ae6f074 None admin] PATH_INFO: `/v3/services/image` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.730942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c51d2b-6489-4a1b-9f5b-875d8ae6f074 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.732554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 512/1022] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:18.732705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c51d2b-6489-4a1b-9f5b-875d8ae6f074 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-38c51d2b-6489-4a1b-9f5b-875d8ae6f074 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:18.741616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:18.742710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:18.743711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:18.748732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 511/1023] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:18.750029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2939370-9f0b-40b9-ba95-df780140c964 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.866529 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2939370-9f0b-40b9-ba95-df780140c964 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.904414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caa7a4-3200-423d-9322-2f77ca92e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.905084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caa7a4-3200-423d-9322-2f77ca92e598 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.905308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caa7a4-3200-423d-9322-2f77ca92e598 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.905578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caa7a4-3200-423d-9322-2f77ca92e598 None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.906207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caa7a4-3200-423d-9322-2f77ca92e598 None admin] RBAC: Adding query filter params (name=image) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:18.906507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caa7a4-3200-423d-9322-2f77ca92e598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.907855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caa7a4-3200-423d-9322-2f77ca92e598 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.913177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 513/1024] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:18.918681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c51d2b-6489-4a1b-9f5b-875d8ae6f074 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.995991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:19.031783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c51d2b-6489-4a1b-9f5b-875d8ae6f074 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:19.067216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3b194-ec9b-4403-8c94-bc81cab05091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:19.067833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3b194-ec9b-4403-8c94-bc81cab05091 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:19.068108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3b194-ec9b-4403-8c94-bc81cab05091 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:19.068376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3b194-ec9b-4403-8c94-bc81cab05091 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:19.069033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3b194-ec9b-4403-8c94-bc81cab05091 None admin] RBAC: Adding query filter params (type=image) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:19.069335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3b194-ec9b-4403-8c94-bc81cab05091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:19.070699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3b194-ec9b-4403-8c94-bc81cab05091 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:19.080701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 512/1025] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:19.082492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caa7a4-3200-423d-9322-2f77ca92e598 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:19.085542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:19.189971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caa7a4-3200-423d-9322-2f77ca92e598 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:19.223041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067dd06-2830-43e0-9f34-8766a1525c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:19.223642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067dd06-2830-43e0-9f34-8766a1525c96 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:19.223917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067dd06-2830-43e0-9f34-8766a1525c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:19.224183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067dd06-2830-43e0-9f34-8766a1525c96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:19.224911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067dd06-2830-43e0-9f34-8766a1525c96 None admin] RBAC: Adding query filter params (interface=public, service_id=ac0e2856e5c443dba55f341112d3c26e, region_id=RegionOne) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:19.225216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067dd06-2830-43e0-9f34-8766a1525c96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:19.226576 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067dd06-2830-43e0-9f34-8766a1525c96 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:19.232377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 514/1026] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:19 2022] GET /identity/v3/endpoints?service_id=ac0e2856e5c443dba55f341112d3c26e&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:19.237876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3b194-ec9b-4403-8c94-bc81cab05091 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:19.347465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3b194-ec9b-4403-8c94-bc81cab05091 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:19.381649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ab6d7-5aa1-42ab-8cd1-43c9d4ff8341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:19.382251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab6d7-5aa1-42ab-8cd1-43c9d4ff8341 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:19.382524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab6d7-5aa1-42ab-8cd1-43c9d4ff8341 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:19.382791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab6d7-5aa1-42ab-8cd1-43c9d4ff8341 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:19.383389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ab6d7-5aa1-42ab-8cd1-43c9d4ff8341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:19.384763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ab6d7-5aa1-42ab-8cd1-43c9d4ff8341 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:19.385803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:19.401831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 513/1027] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:19 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:10:20.411426 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaecc1c-0d69-4ecd-a7fc-b853cb215258 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.411945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaecc1c-0d69-4ecd-a7fc-b853cb215258 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.411945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaecc1c-0d69-4ecd-a7fc-b853cb215258 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.413486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 515/1028] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:20.419310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70939ad6-938f-4c6d-9fac-2cf1fc5331fd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.420345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70939ad6-938f-4c6d-9fac-2cf1fc5331fd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.420599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70939ad6-938f-4c6d-9fac-2cf1fc5331fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.439499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-70939ad6-938f-4c6d-9fac-2cf1fc5331fd None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:20.440727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-70939ad6-938f-4c6d-9fac-2cf1fc5331fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:20.509564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 514/1029] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:20.534061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaecc1c-0d69-4ecd-a7fc-b853cb215258 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:20.605516 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:20.643089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaecc1c-0d69-4ecd-a7fc-b853cb215258 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.677969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961fe21-d5ed-4e9a-afc5-86dad1afc784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.678519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961fe21-d5ed-4e9a-afc5-86dad1afc784 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.678796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961fe21-d5ed-4e9a-afc5-86dad1afc784 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.679066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961fe21-d5ed-4e9a-afc5-86dad1afc784 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.680174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961fe21-d5ed-4e9a-afc5-86dad1afc784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:20.681627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961fe21-d5ed-4e9a-afc5-86dad1afc784 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:20.683346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 516/1030] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:20.688925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70939ad6-938f-4c6d-9fac-2cf1fc5331fd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:20.788263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70939ad6-938f-4c6d-9fac-2cf1fc5331fd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.814600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:20.823099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaa134-9781-4eef-8b05-1900ea2f23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.823732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa134-9781-4eef-8b05-1900ea2f23dd None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.824005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa134-9781-4eef-8b05-1900ea2f23dd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.824268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa134-9781-4eef-8b05-1900ea2f23dd None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.824946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaa134-9781-4eef-8b05-1900ea2f23dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:20.827032 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaa134-9781-4eef-8b05-1900ea2f23dd None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:20.850180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 515/1031] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:10:20 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:20.929250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf29913-172b-4481-982f-4742d7ceb7bd None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.929430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf29913-172b-4481-982f-4742d7ceb7bd None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.929696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf29913-172b-4481-982f-4742d7ceb7bd None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.931283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 517/1032] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:20.937947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c7c7-5013-40d9-92c8-556a6096f4b7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.938231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c7c7-5013-40d9-92c8-556a6096f4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.938501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c7c7-5013-40d9-92c8-556a6096f4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.958983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a4d1c7c7-5013-40d9-92c8-556a6096f4b7 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:20.960188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a4d1c7c7-5013-40d9-92c8-556a6096f4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:21.034117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 516/1033] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:21.057530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf29913-172b-4481-982f-4742d7ceb7bd None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.170729 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf29913-172b-4481-982f-4742d7ceb7bd None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.205514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0f00d-42a4-4233-84c7-2da721a2bc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.206048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0f00d-42a4-4233-84c7-2da721a2bc46 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.206324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0f00d-42a4-4233-84c7-2da721a2bc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.206592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0f00d-42a4-4233-84c7-2da721a2bc46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.208451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.219944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0f00d-42a4-4233-84c7-2da721a2bc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-34b0f00d-42a4-4233-84c7-2da721a2bc46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:21.224594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:21.225554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:21.226431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 518/1034] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:21.232649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1c7c7-5013-40d9-92c8-556a6096f4b7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.335821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1c7c7-5013-40d9-92c8-556a6096f4b7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.350890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.388960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd240e-6842-438c-9e8d-397d1e0ad656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.389572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd240e-6842-438c-9e8d-397d1e0ad656 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.389853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd240e-6842-438c-9e8d-397d1e0ad656 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.390120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd240e-6842-438c-9e8d-397d1e0ad656 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.390783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd240e-6842-438c-9e8d-397d1e0ad656 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:21.391081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd240e-6842-438c-9e8d-397d1e0ad656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.392439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd240e-6842-438c-9e8d-397d1e0ad656 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.402247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 517/1035] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:21.408695 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0f00d-42a4-4233-84c7-2da721a2bc46 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.438890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304597f7-7f8f-4b54-a616-7a965f2846b8 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.439437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304597f7-7f8f-4b54-a616-7a965f2846b8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.439437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304597f7-7f8f-4b54-a616-7a965f2846b8 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.440931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 518/1036] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:21.445662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7469e37-e176-4eab-9310-ce4dc34f25f0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.445939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7469e37-e176-4eab-9310-ce4dc34f25f0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.446208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7469e37-e176-4eab-9310-ce4dc34f25f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.465306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e7469e37-e176-4eab-9310-ce4dc34f25f0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:21.467076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e7469e37-e176-4eab-9310-ce4dc34f25f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:21.519646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0f00d-42a4-4233-84c7-2da721a2bc46 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.537813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 519/1037] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:21.557937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefeb860-0868-4e82-a57d-ea3ba6d98e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.558568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefeb860-0868-4e82-a57d-ea3ba6d98e90 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.558849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefeb860-0868-4e82-a57d-ea3ba6d98e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.559123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefeb860-0868-4e82-a57d-ea3ba6d98e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.561877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7469e37-e176-4eab-9310-ce4dc34f25f0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.571811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefeb860-0868-4e82-a57d-ea3ba6d98e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.573698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefeb860-0868-4e82-a57d-ea3ba6d98e90 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-eefeb860-0868-4e82-a57d-ea3ba6d98e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:21.593824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:21.594929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:21.595826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:21.595826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:21.595826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:21.595826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 519/1038] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:21.601233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefeb860-0868-4e82-a57d-ea3ba6d98e90 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.648766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.671640 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7469e37-e176-4eab-9310-ce4dc34f25f0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.680006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.708982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefeb860-0868-4e82-a57d-ea3ba6d98e90 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.709897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77599a89-25a5-4cb6-aa89-079e0b2e253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.710694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77599a89-25a5-4cb6-aa89-079e0b2e253e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.710978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77599a89-25a5-4cb6-aa89-079e0b2e253e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.712025 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77599a89-25a5-4cb6-aa89-079e0b2e253e None admin] PATH_INFO: `/v3/services/image` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.712615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77599a89-25a5-4cb6-aa89-079e0b2e253e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.714045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77599a89-25a5-4cb6-aa89-079e0b2e253e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-77599a89-25a5-4cb6-aa89-079e0b2e253e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:21.724413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:21.725579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:21.726422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 520/1039] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:21.732464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77599a89-25a5-4cb6-aa89-079e0b2e253e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.747729 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96618d6d-10ee-40e8-9aed-81816590c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.748368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96618d6d-10ee-40e8-9aed-81816590c704 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.748671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96618d6d-10ee-40e8-9aed-81816590c704 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.748949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96618d6d-10ee-40e8-9aed-81816590c704 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.749586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96618d6d-10ee-40e8-9aed-81816590c704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:21.749889 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96618d6d-10ee-40e8-9aed-81816590c704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.751251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96618d6d-10ee-40e8-9aed-81816590c704 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.767817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 520/1040] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:21.769055 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96618d6d-10ee-40e8-9aed-81816590c704 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.843979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77599a89-25a5-4cb6-aa89-079e0b2e253e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.873609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96618d6d-10ee-40e8-9aed-81816590c704 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.880797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.881748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f299c-17ab-4ce1-812e-b24dc61726e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.882585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f299c-17ab-4ce1-812e-b24dc61726e3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.883082 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f299c-17ab-4ce1-812e-b24dc61726e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.883379 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f299c-17ab-4ce1-812e-b24dc61726e3 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.884694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f299c-17ab-4ce1-812e-b24dc61726e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:21.884998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f299c-17ab-4ce1-812e-b24dc61726e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.886476 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f299c-17ab-4ce1-812e-b24dc61726e3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.897013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 521/1041] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:21.898012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f299c-17ab-4ce1-812e-b24dc61726e3 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.912382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632faa1-fe83-407f-8b2b-0f9cf1853589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.913164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632faa1-fe83-407f-8b2b-0f9cf1853589 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.913507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632faa1-fe83-407f-8b2b-0f9cf1853589 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.913888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632faa1-fe83-407f-8b2b-0f9cf1853589 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.923316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632faa1-fe83-407f-8b2b-0f9cf1853589 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.925288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632faa1-fe83-407f-8b2b-0f9cf1853589 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.931457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-6632faa1-fe83-407f-8b2b-0f9cf1853589 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:21.938015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:21.938981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:21.941828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 521/1042] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:21.944608 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632faa1-fe83-407f-8b2b-0f9cf1853589 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.008570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f299c-17ab-4ce1-812e-b24dc61726e3 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.043218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f85c8-0a17-47b3-96d4-e8107bbb26f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.044406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f85c8-0a17-47b3-96d4-e8107bbb26f7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.044713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f85c8-0a17-47b3-96d4-e8107bbb26f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.045019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f85c8-0a17-47b3-96d4-e8107bbb26f7 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.045616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f85c8-0a17-47b3-96d4-e8107bbb26f7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:22.045920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f85c8-0a17-47b3-96d4-e8107bbb26f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.047320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f85c8-0a17-47b3-96d4-e8107bbb26f7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.053338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 522/1043] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:22.060198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f85c8-0a17-47b3-96d4-e8107bbb26f7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.062827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632faa1-fe83-407f-8b2b-0f9cf1853589 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.098188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f3029-1848-48b7-bc8c-ab7d9079fa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.098789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3029-1848-48b7-bc8c-ab7d9079fa8a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.099062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3029-1848-48b7-bc8c-ab7d9079fa8a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.099327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f3029-1848-48b7-bc8c-ab7d9079fa8a None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.100039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3029-1848-48b7-bc8c-ab7d9079fa8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:22.100339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3029-1848-48b7-bc8c-ab7d9079fa8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.101794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f3029-1848-48b7-bc8c-ab7d9079fa8a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.119575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 522/1044] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:22.125698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f3029-1848-48b7-bc8c-ab7d9079fa8a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.151206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:22.171246 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:22.177428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f85c8-0a17-47b3-96d4-e8107bbb26f7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.211824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cba5d3-607e-4113-9faa-b92877030f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.212710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba5d3-607e-4113-9faa-b92877030f04 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.213134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba5d3-607e-4113-9faa-b92877030f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.213563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba5d3-607e-4113-9faa-b92877030f04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.214374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cba5d3-607e-4113-9faa-b92877030f04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.216685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cba5d3-607e-4113-9faa-b92877030f04 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.234989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f3029-1848-48b7-bc8c-ab7d9079fa8a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.248653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 523/1045] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:22.284468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7f096-e077-499a-bd8c-790e5abbdd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.285015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7f096-e077-499a-bd8c-790e5abbdd3d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.285286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7f096-e077-499a-bd8c-790e5abbdd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.285552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7f096-e077-499a-bd8c-790e5abbdd3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.368023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7f096-e077-499a-bd8c-790e5abbdd3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.369522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7f096-e077-499a-bd8c-790e5abbdd3d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.392938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:22.479888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 523/1046] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 12:10:22.485463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cba5d3-607e-4113-9faa-b92877030f04 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.590833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cba5d3-607e-4113-9faa-b92877030f04 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.625355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781f928-c39b-45a6-92bc-3be3cd1b9996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.625985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781f928-c39b-45a6-92bc-3be3cd1b9996 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.626260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781f928-c39b-45a6-92bc-3be3cd1b9996 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.626525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781f928-c39b-45a6-92bc-3be3cd1b9996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.637304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781f928-c39b-45a6-92bc-3be3cd1b9996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.639513 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781f928-c39b-45a6-92bc-3be3cd1b9996 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e781f928-c39b-45a6-92bc-3be3cd1b9996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:22.653763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:22.654728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:22.655691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:22.655691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:22.655691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:22.659532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 524/1047] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:22.660958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7f096-e077-499a-bd8c-790e5abbdd3d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.767055 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7f096-e077-499a-bd8c-790e5abbdd3d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.787118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:22.802977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aad6a8-ed4f-4c03-bb41-03e23ba7b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.803578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aad6a8-ed4f-4c03-bb41-03e23ba7b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.803848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aad6a8-ed4f-4c03-bb41-03e23ba7b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.804114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aad6a8-ed4f-4c03-bb41-03e23ba7b7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.804773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aad6a8-ed4f-4c03-bb41-03e23ba7b7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:22.805070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aad6a8-ed4f-4c03-bb41-03e23ba7b7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.806422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aad6a8-ed4f-4c03-bb41-03e23ba7b7f9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.818468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 524/1048] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:22.824311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781f928-c39b-45a6-92bc-3be3cd1b9996 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.837752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:22.931606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781f928-c39b-45a6-92bc-3be3cd1b9996 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.964916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cb3f4-baf3-4f76-884c-c90daa61421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.965763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cb3f4-baf3-4f76-884c-c90daa61421a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.966024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cb3f4-baf3-4f76-884c-c90daa61421a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.966514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cb3f4-baf3-4f76-884c-c90daa61421a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.971880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84d4c-de9e-4343-804d-f413b4c4d701 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.972166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84d4c-de9e-4343-804d-f413b4c4d701 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.972446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84d4c-de9e-4343-804d-f413b4c4d701 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.973372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cb3f4-baf3-4f76-884c-c90daa61421a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.973954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 525/1049] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:22.974841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cb3f4-baf3-4f76-884c-c90daa61421a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.978715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c648b76-bed7-43ce-9a05-ce1df363c59c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.979095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c648b76-bed7-43ce-9a05-ce1df363c59c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.979431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c648b76-bed7-43ce-9a05-ce1df363c59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-977cb3f4-baf3-4f76-884c-c90daa61421a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:22.987579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:22.988593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:22.989532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:22.989532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:22.989532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:22.989532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:22.989532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:22.989532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:22.989532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:22.989532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:22.989532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 525/1050] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:22.994366 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cb3f4-baf3-4f76-884c-c90daa61421a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:23.000878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-8c648b76-bed7-43ce-9a05-ce1df363c59c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:23.002226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8c648b76-bed7-43ce-9a05-ce1df363c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:23.064113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:23.087269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 526/1051] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:23.102730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cb3f4-baf3-4f76-884c-c90daa61421a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:23.111416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c648b76-bed7-43ce-9a05-ce1df363c59c None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:23.137605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b848be-5c4e-4a53-ae3d-406103eddc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:23.138206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b848be-5c4e-4a53-ae3d-406103eddc5e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.138486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b848be-5c4e-4a53-ae3d-406103eddc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.138820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b848be-5c4e-4a53-ae3d-406103eddc5e None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.139516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b848be-5c4e-4a53-ae3d-406103eddc5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:23.139820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b848be-5c4e-4a53-ae3d-406103eddc5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:23.141292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b848be-5c4e-4a53-ae3d-406103eddc5e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:23.154150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 526/1052] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:23.160004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b848be-5c4e-4a53-ae3d-406103eddc5e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:23.217856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c648b76-bed7-43ce-9a05-ce1df363c59c None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:23.229577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:23.256821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee074da-80f8-4b71-8b2e-3fd3ad372b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:23.257461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee074da-80f8-4b71-8b2e-3fd3ad372b7e None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.257736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee074da-80f8-4b71-8b2e-3fd3ad372b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.258004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee074da-80f8-4b71-8b2e-3fd3ad372b7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.264133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b848be-5c4e-4a53-ae3d-406103eddc5e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:23.268991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee074da-80f8-4b71-8b2e-3fd3ad372b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-3ee074da-80f8-4b71-8b2e-3fd3ad372b7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:23.273653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:23.274606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:23.275837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 527/1053] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:23.281286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee074da-80f8-4b71-8b2e-3fd3ad372b7e None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:23.295551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:23.305902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ded37-12ce-4568-a3fb-14ac95b107a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:23.306555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ded37-12ce-4568-a3fb-14ac95b107a8 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.306836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ded37-12ce-4568-a3fb-14ac95b107a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.307105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ded37-12ce-4568-a3fb-14ac95b107a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.307932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ded37-12ce-4568-a3fb-14ac95b107a8 None admin] RBAC: Adding query filter params (role.id=b6c2fce401ec4816aae2928181962c37, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=98925192a33544e081f1a02faed60b7f) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:23.308240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ded37-12ce-4568-a3fb-14ac95b107a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:23.309909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ded37-12ce-4568-a3fb-14ac95b107a8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:23.324701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 527/1054] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:23 2022] GET /identity/v3/role_assignments?user.id=98925192a33544e081f1a02faed60b7f&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=b6c2fce401ec4816aae2928181962c37 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:23.406876 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee074da-80f8-4b71-8b2e-3fd3ad372b7e None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:23.447969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa94ee6-7733-4264-a57a-3afdc7e28c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:23.448580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa94ee6-7733-4264-a57a-3afdc7e28c00 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.448887 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa94ee6-7733-4264-a57a-3afdc7e28c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.449155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa94ee6-7733-4264-a57a-3afdc7e28c00 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.449826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa94ee6-7733-4264-a57a-3afdc7e28c00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:23.450158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa94ee6-7733-4264-a57a-3afdc7e28c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:23.451554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa94ee6-7733-4264-a57a-3afdc7e28c00 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:23.461287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 528/1055] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:23.467415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ded37-12ce-4568-a3fb-14ac95b107a8 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:23.569972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ded37-12ce-4568-a3fb-14ac95b107a8 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:23.603554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b396a6a-654f-425a-815a-e10d6dc1f36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:23.604179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b396a6a-654f-425a-815a-e10d6dc1f36d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.604451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b396a6a-654f-425a-815a-e10d6dc1f36d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.604746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b396a6a-654f-425a-815a-e10d6dc1f36d None admin] PATH_INFO: `/v3/users/35efb3c0a4e74a8a87587f91035129b7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.618111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b396a6a-654f-425a-815a-e10d6dc1f36d None admin] RBAC: Authorizing `identity:get_user(user_id=35efb3c0a4e74a8a87587f91035129b7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:23.619526 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b396a6a-654f-425a-815a-e10d6dc1f36d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:23.624758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 528/1056] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:23 2022] GET /identity/v3/users/35efb3c0a4e74a8a87587f91035129b7 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:23.627609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa94ee6-7733-4264-a57a-3afdc7e28c00 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:23.661139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:23.733984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa94ee6-7733-4264-a57a-3afdc7e28c00 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:23.768138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a9c03-3cac-4435-bd7a-b1a390830e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:23.768814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a9c03-3cac-4435-bd7a-b1a390830e76 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.769091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a9c03-3cac-4435-bd7a-b1a390830e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.769360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a9c03-3cac-4435-bd7a-b1a390830e76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.837915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a9c03-3cac-4435-bd7a-b1a390830e76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:23.839342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a9c03-3cac-4435-bd7a-b1a390830e76 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:23.869198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:23.948157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 529/1057] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 12:10:23.948377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b396a6a-654f-425a-815a-e10d6dc1f36d None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:23.999789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:24.051353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b396a6a-654f-425a-815a-e10d6dc1f36d None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:24.086652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b253a-a662-4c7a-8b7f-7784b3012c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:24.087281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b253a-a662-4c7a-8b7f-7784b3012c55 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.087553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b253a-a662-4c7a-8b7f-7784b3012c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.087818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b253a-a662-4c7a-8b7f-7784b3012c55 None admin] PATH_INFO: `/v3/projects/7e9893af6a024ae2bfb05cabdf47460c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.088991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b253a-a662-4c7a-8b7f-7784b3012c55 None admin] RBAC: Authorizing `identity:get_project(project_id=7e9893af6a024ae2bfb05cabdf47460c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:24.090352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b253a-a662-4c7a-8b7f-7784b3012c55 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:24.096977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 529/1058] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:23 2022] GET /identity/v3/projects/7e9893af6a024ae2bfb05cabdf47460c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:24.098167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a9c03-3cac-4435-bd7a-b1a390830e76 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:24.195763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a9c03-3cac-4435-bd7a-b1a390830e76 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:24.225298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:24.231863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd1be3-6fb6-4c91-abcf-f772ec3458de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:24.232708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd1be3-6fb6-4c91-abcf-f772ec3458de None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.232927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd1be3-6fb6-4c91-abcf-f772ec3458de None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.233190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd1be3-6fb6-4c91-abcf-f772ec3458de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.233904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd1be3-6fb6-4c91-abcf-f772ec3458de None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=7e9893af6a024ae2bfb05cabdf47460c, user.id=35efb3c0a4e74a8a87587f91035129b7) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:24.234202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd1be3-6fb6-4c91-abcf-f772ec3458de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:24.235614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd1be3-6fb6-4c91-abcf-f772ec3458de None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:24.248663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 530/1059] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:24 2022] GET /identity/v3/role_assignments?user.id=35efb3c0a4e74a8a87587f91035129b7&scope.project.id=7e9893af6a024ae2bfb05cabdf47460c&role.id=d6155b01aace49f887f29aa2861d31cf => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:24.320902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffa639-db1b-47df-a16e-a56a1b3c4c43 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.321182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffa639-db1b-47df-a16e-a56a1b3c4c43 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.321450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffa639-db1b-47df-a16e-a56a1b3c4c43 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.323053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 530/1060] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:24.329726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fdb1f-c44a-4d6e-b039-98df0f47080b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.330004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fdb1f-c44a-4d6e-b039-98df0f47080b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.330275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fdb1f-c44a-4d6e-b039-98df0f47080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.350400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-995fdb1f-c44a-4d6e-b039-98df0f47080b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:24.351534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-995fdb1f-c44a-4d6e-b039-98df0f47080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:24.432657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 531/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:24.452075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffa639-db1b-47df-a16e-a56a1b3c4c43 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:24.554267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffa639-db1b-47df-a16e-a56a1b3c4c43 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:24.571772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:24.592475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04c077-5e6b-4c78-81eb-bc9ce305fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:24.593112 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04c077-5e6b-4c78-81eb-bc9ce305fb54 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.593386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04c077-5e6b-4c78-81eb-bc9ce305fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.593653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04c077-5e6b-4c78-81eb-bc9ce305fb54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.661684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04c077-5e6b-4c78-81eb-bc9ce305fb54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:24.663116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04c077-5e6b-4c78-81eb-bc9ce305fb54 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:24.767147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 531/1062] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:24.768446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fdb1f-c44a-4d6e-b039-98df0f47080b None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:24.868712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fdb1f-c44a-4d6e-b039-98df0f47080b None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:24.894823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:24.905099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b505a1d-123d-4888-bb07-cff108953fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:24.905730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b505a1d-123d-4888-bb07-cff108953fad None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.906004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b505a1d-123d-4888-bb07-cff108953fad None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.906269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b505a1d-123d-4888-bb07-cff108953fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.925978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b505a1d-123d-4888-bb07-cff108953fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:24.927406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b505a1d-123d-4888-bb07-cff108953fad None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-0b505a1d-123d-4888-bb07-cff108953fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:24.942636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:24.943633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:24.949551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:24.949551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:24.949551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:24.949551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 532/1063] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:24.949956 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04c077-5e6b-4c78-81eb-bc9ce305fb54 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:24.968022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:25.050435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04c077-5e6b-4c78-81eb-bc9ce305fb54 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:25.083834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170dcf8-200e-47db-a324-7fee058acba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:25.084436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170dcf8-200e-47db-a324-7fee058acba2 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.084738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170dcf8-200e-47db-a324-7fee058acba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.085007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170dcf8-200e-47db-a324-7fee058acba2 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.085644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170dcf8-200e-47db-a324-7fee058acba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:25.085997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170dcf8-200e-47db-a324-7fee058acba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:25.087385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170dcf8-200e-47db-a324-7fee058acba2 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:25.099444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 532/1064] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:25.330075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8212d5c-0d29-4e17-9f55-dc49c75bbef0 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.330276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8212d5c-0d29-4e17-9f55-dc49c75bbef0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.330538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8212d5c-0d29-4e17-9f55-dc49c75bbef0 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.331913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 533/1065] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:25.337880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569628f3-4c12-4325-94eb-403e5375d723 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.338201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569628f3-4c12-4325-94eb-403e5375d723 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.338439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569628f3-4c12-4325-94eb-403e5375d723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.360909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-569628f3-4c12-4325-94eb-403e5375d723 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:25.362115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-569628f3-4c12-4325-94eb-403e5375d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:25.433637 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 533/1066] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:25.456801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8212d5c-0d29-4e17-9f55-dc49c75bbef0 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.555032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8212d5c-0d29-4e17-9f55-dc49c75bbef0 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:25.588797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb02611-aaeb-4c30-bf71-f2d4df2ef5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:25.589351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb02611-aaeb-4c30-bf71-f2d4df2ef5bc None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.589627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb02611-aaeb-4c30-bf71-f2d4df2ef5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.589894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb02611-aaeb-4c30-bf71-f2d4df2ef5bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.600320 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb02611-aaeb-4c30-bf71-f2d4df2ef5bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-6eb02611-aaeb-4c30-bf71-f2d4df2ef5bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:25.604946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:25.606037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:25.606920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 534/1067] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:25.612035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569628f3-4c12-4325-94eb-403e5375d723 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.620389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:25.709815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569628f3-4c12-4325-94eb-403e5375d723 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:25.742818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9247a0f-e9bd-4756-8296-b357a00572f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:25.743422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9247a0f-e9bd-4756-8296-b357a00572f7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.743699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9247a0f-e9bd-4756-8296-b357a00572f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.743971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9247a0f-e9bd-4756-8296-b357a00572f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.744642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9247a0f-e9bd-4756-8296-b357a00572f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:25.744954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9247a0f-e9bd-4756-8296-b357a00572f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:25.746307 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9247a0f-e9bd-4756-8296-b357a00572f7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:25.754806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 534/1068] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:25.760549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb02611-aaeb-4c30-bf71-f2d4df2ef5bc None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.800175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:25.860801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb02611-aaeb-4c30-bf71-f2d4df2ef5bc None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:25.893630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8cea4-e052-4252-b7c5-6ae184d5041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:25.894249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8cea4-e052-4252-b7c5-6ae184d5041c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.894528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8cea4-e052-4252-b7c5-6ae184d5041c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.894797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8cea4-e052-4252-b7c5-6ae184d5041c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.905195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8cea4-e052-4252-b7c5-6ae184d5041c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:25.906641 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8cea4-e052-4252-b7c5-6ae184d5041c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-9ac8cea4-e052-4252-b7c5-6ae184d5041c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:25.920884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:25.922027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:25.923211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:25.923211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:25.923211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:25.923211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 535/1069] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:25.928174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9247a0f-e9bd-4756-8296-b357a00572f7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.993610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.028800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9247a0f-e9bd-4756-8296-b357a00572f7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.062402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5631c-549f-4746-905f-87c74f83733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.063001 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5631c-549f-4746-905f-87c74f83733b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.063278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5631c-549f-4746-905f-87c74f83733b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.063547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5631c-549f-4746-905f-87c74f83733b None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.064181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5631c-549f-4746-905f-87c74f83733b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:26.064479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5631c-549f-4746-905f-87c74f83733b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.065868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5631c-549f-4746-905f-87c74f83733b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.078944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 535/1070] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:26.085092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8cea4-e052-4252-b7c5-6ae184d5041c None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.177538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.187721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8cea4-e052-4252-b7c5-6ae184d5041c None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.221164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb30e-e0d7-4aa1-a2e1-0943cd6a09da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.221781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb30e-e0d7-4aa1-a2e1-0943cd6a09da None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.222062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb30e-e0d7-4aa1-a2e1-0943cd6a09da None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.222332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb30e-e0d7-4aa1-a2e1-0943cd6a09da None admin] PATH_INFO: `/v3/users/nova` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.229862 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb30e-e0d7-4aa1-a2e1-0943cd6a09da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.230819 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7df99e-966d-4a74-b206-8c1fd37906a4 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.231780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7df99e-966d-4a74-b206-8c1fd37906a4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.231938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb30e-e0d7-4aa1-a2e1-0943cd6a09da None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.232058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7df99e-966d-4a74-b206-8c1fd37906a4 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.233394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 536/1071] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:26.238170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8aa2-456b-48e9-be90-9245d22b2c23 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.238448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8aa2-456b-48e9-be90-9245d22b2c23 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.238715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8aa2-456b-48e9-be90-9245d22b2c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-26abb30e-e0d7-4aa1-a2e1-0943cd6a09da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:26.243532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:26.244709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:26.245659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 536/1072] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:26.250274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb30e-e0d7-4aa1-a2e1-0943cd6a09da None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.258323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c93e8aa2-456b-48e9-be90-9245d22b2c23 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:26.259489 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c93e8aa2-456b-48e9-be90-9245d22b2c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:26.324098 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 537/1073] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:26.347232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e8aa2-456b-48e9-be90-9245d22b2c23 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.349173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb30e-e0d7-4aa1-a2e1-0943cd6a09da None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.383540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584130d9-8998-4331-9b79-e50ade59de9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.384133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584130d9-8998-4331-9b79-e50ade59de9a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.384412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584130d9-8998-4331-9b79-e50ade59de9a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.384715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584130d9-8998-4331-9b79-e50ade59de9a None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.385429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584130d9-8998-4331-9b79-e50ade59de9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:26.385729 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584130d9-8998-4331-9b79-e50ade59de9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.387153 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584130d9-8998-4331-9b79-e50ade59de9a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.404603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 537/1074] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:26.405297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.410221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584130d9-8998-4331-9b79-e50ade59de9a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.423868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.448952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e8aa2-456b-48e9-be90-9245d22b2c23 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.483024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a14f-d473-455c-8057-946f46fe7999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.483649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a14f-d473-455c-8057-946f46fe7999 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.483922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a14f-d473-455c-8057-946f46fe7999 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.484187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a14f-d473-455c-8057-946f46fe7999 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.494040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968a14f-d473-455c-8057-946f46fe7999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-0968a14f-d473-455c-8057-946f46fe7999 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:26.498935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:26.500057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:26.500981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 538/1075] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:26.506066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a14f-d473-455c-8057-946f46fe7999 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.513217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584130d9-8998-4331-9b79-e50ade59de9a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.547065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6963e-1c4c-44fb-b297-af7e02dab644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.547692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6963e-1c4c-44fb-b297-af7e02dab644 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.547972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6963e-1c4c-44fb-b297-af7e02dab644 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.548238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6963e-1c4c-44fb-b297-af7e02dab644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.558485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6963e-1c4c-44fb-b297-af7e02dab644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.560113 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6963e-1c4c-44fb-b297-af7e02dab644 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-bca6963e-1c4c-44fb-b297-af7e02dab644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:26.574154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:26.575805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:26.576773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:26.576773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:26.576773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:26.576773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 538/1076] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:26.581385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6963e-1c4c-44fb-b297-af7e02dab644 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.610936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a14f-d473-455c-8057-946f46fe7999 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.627782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.638787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.645557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d411d1-4705-455c-839c-e779780e1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.646157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d411d1-4705-455c-839c-e779780e1774 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.646436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d411d1-4705-455c-839c-e779780e1774 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.646706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d411d1-4705-455c-839c-e779780e1774 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.647360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d411d1-4705-455c-839c-e779780e1774 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:26.647661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d411d1-4705-455c-839c-e779780e1774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.649052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d411d1-4705-455c-839c-e779780e1774 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.657771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 539/1077] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:26.663559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d411d1-4705-455c-839c-e779780e1774 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.679350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6963e-1c4c-44fb-b297-af7e02dab644 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.712971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb78bd8-db40-464f-afd5-a3fecf9d7396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.713499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb78bd8-db40-464f-afd5-a3fecf9d7396 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.713776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb78bd8-db40-464f-afd5-a3fecf9d7396 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.714045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb78bd8-db40-464f-afd5-a3fecf9d7396 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.714680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb78bd8-db40-464f-afd5-a3fecf9d7396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:26.714978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb78bd8-db40-464f-afd5-a3fecf9d7396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.717037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb78bd8-db40-464f-afd5-a3fecf9d7396 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.728339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 539/1078] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:26.734227 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb78bd8-db40-464f-afd5-a3fecf9d7396 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.765697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d411d1-4705-455c-839c-e779780e1774 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.798897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5db766-8845-42fa-bc89-d2d6199a6f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.799511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5db766-8845-42fa-bc89-d2d6199a6f04 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.799784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5db766-8845-42fa-bc89-d2d6199a6f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.800051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5db766-8845-42fa-bc89-d2d6199a6f04 None admin] PATH_INFO: `/v3/users/35efb3c0a4e74a8a87587f91035129b7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.801189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5db766-8845-42fa-bc89-d2d6199a6f04 None admin] RBAC: Authorizing `identity:get_user(user_id=35efb3c0a4e74a8a87587f91035129b7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.802602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5db766-8845-42fa-bc89-d2d6199a6f04 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.804180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 540/1079] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/users/35efb3c0a4e74a8a87587f91035129b7 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:26.809887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5db766-8845-42fa-bc89-d2d6199a6f04 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.831081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb78bd8-db40-464f-afd5-a3fecf9d7396 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.852327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.858736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.866385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e5b08-5b56-4d78-bd3c-7484ae4154db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.867009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e5b08-5b56-4d78-bd3c-7484ae4154db None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.867283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e5b08-5b56-4d78-bd3c-7484ae4154db None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.867543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e5b08-5b56-4d78-bd3c-7484ae4154db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.874913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e5b08-5b56-4d78-bd3c-7484ae4154db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.876354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e5b08-5b56-4d78-bd3c-7484ae4154db None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-173e5b08-5b56-4d78-bd3c-7484ae4154db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:26.888120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:26.889295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:26.890181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:26.890181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:26.890181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:26.890181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:26.890181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:26.890181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:26.890181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:26.890181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:26.892774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 540/1080] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:26.895684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e5b08-5b56-4d78-bd3c-7484ae4154db None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.912576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5db766-8845-42fa-bc89-d2d6199a6f04 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.947550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d775893-7c3e-4830-b364-fd6e43c63fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.948175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775893-7c3e-4830-b364-fd6e43c63fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.948455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775893-7c3e-4830-b364-fd6e43c63fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.948768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775893-7c3e-4830-b364-fd6e43c63fc1 None admin] PATH_INFO: `/v3/projects/7e9893af6a024ae2bfb05cabdf47460c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.950470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d775893-7c3e-4830-b364-fd6e43c63fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=7e9893af6a024ae2bfb05cabdf47460c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.951901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d775893-7c3e-4830-b364-fd6e43c63fc1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.953592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 541/1081] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/projects/7e9893af6a024ae2bfb05cabdf47460c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:26.959636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d775893-7c3e-4830-b364-fd6e43c63fc1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:27.000660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e5b08-5b56-4d78-bd3c-7484ae4154db None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.034590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46116bce-c3e6-4062-9fd6-f8f21486c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.035188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46116bce-c3e6-4062-9fd6-f8f21486c1ba None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.035466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46116bce-c3e6-4062-9fd6-f8f21486c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.035739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46116bce-c3e6-4062-9fd6-f8f21486c1ba None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.036419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46116bce-c3e6-4062-9fd6-f8f21486c1ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:27.036762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46116bce-c3e6-4062-9fd6-f8f21486c1ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.038221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46116bce-c3e6-4062-9fd6-f8f21486c1ba None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.049858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 541/1082] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:27.055640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46116bce-c3e6-4062-9fd6-f8f21486c1ba None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:27.061154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d775893-7c3e-4830-b364-fd6e43c63fc1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.077159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:27.096047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d01c8-4658-47ea-b2ea-4a3b3a06f3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.096731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d01c8-4658-47ea-b2ea-4a3b3a06f3e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.097012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d01c8-4658-47ea-b2ea-4a3b3a06f3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.097281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d01c8-4658-47ea-b2ea-4a3b3a06f3e0 None admin] PATH_INFO: `/v3/projects/7e9893af6a024ae2bfb05cabdf47460c/users/35efb3c0a4e74a8a87587f91035129b7/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.098258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:27.099201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d01c8-4658-47ea-b2ea-4a3b3a06f3e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e9893af6a024ae2bfb05cabdf47460c, user_id=35efb3c0a4e74a8a87587f91035129b7, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.100651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d01c8-4658-47ea-b2ea-4a3b3a06f3e0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.113328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 542/1083] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:26 2022] PUT /identity/v3/projects/7e9893af6a024ae2bfb05cabdf47460c/users/35efb3c0a4e74a8a87587f91035129b7/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:10:27.160714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46116bce-c3e6-4062-9fd6-f8f21486c1ba None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.199420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb2fba-d105-4a51-90b6-3a05bfb2bd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.200121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb2fba-d105-4a51-90b6-3a05bfb2bd54 None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.200400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb2fba-d105-4a51-90b6-3a05bfb2bd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.200693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb2fba-d105-4a51-90b6-3a05bfb2bd54 None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/98925192a33544e081f1a02faed60b7f/roles/b6c2fce401ec4816aae2928181962c37` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.202899 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb2fba-d105-4a51-90b6-3a05bfb2bd54 None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=98925192a33544e081f1a02faed60b7f, role_id=b6c2fce401ec4816aae2928181962c37)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.204353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb2fba-d105-4a51-90b6-3a05bfb2bd54 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.219376 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 542/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:27 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/98925192a33544e081f1a02faed60b7f/roles/b6c2fce401ec4816aae2928181962c37 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:10:29.095591 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bea4-15dd-4b40-accb-d4ebe41cea6b None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.096197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bea4-15dd-4b40-accb-d4ebe41cea6b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.096197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bea4-15dd-4b40-accb-d4ebe41cea6b None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.097517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 543/1085] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:29.102831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8296a5-6beb-4c8f-aa2c-757bd735a0b8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.103261 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8296a5-6beb-4c8f-aa2c-757bd735a0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.103366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8296a5-6beb-4c8f-aa2c-757bd735a0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.121488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-dc8296a5-6beb-4c8f-aa2c-757bd735a0b8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:29.122821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-dc8296a5-6beb-4c8f-aa2c-757bd735a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:29.187265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 543/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:29.192008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac3d44-1ec1-459a-9bed-352a2063cfc9 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.192360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac3d44-1ec1-459a-9bed-352a2063cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.192734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac3d44-1ec1-459a-9bed-352a2063cfc9 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.195184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 544/1087] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:29.200236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff3965-918a-4e69-a893-fb35ec515dcd None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.200523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff3965-918a-4e69-a893-fb35ec515dcd None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.200826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff3965-918a-4e69-a893-fb35ec515dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.210235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac3d44-1ec1-459a-9bed-352a2063cfc9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.218961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-dcff3965-918a-4e69-a893-fb35ec515dcd None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:29.220129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-dcff3965-918a-4e69-a893-fb35ec515dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:29.243604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:29.286813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 544/1088] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:29.310649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff3965-918a-4e69-a893-fb35ec515dcd None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.313047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac3d44-1ec1-459a-9bed-352a2063cfc9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.345905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9135c-1a5f-4e21-b735-35f29e327f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.346457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9135c-1a5f-4e21-b735-35f29e327f5f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.346732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9135c-1a5f-4e21-b735-35f29e327f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.346998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9135c-1a5f-4e21-b735-35f29e327f5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.358037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9135c-1a5f-4e21-b735-35f29e327f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-59d9135c-1a5f-4e21-b735-35f29e327f5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:29.362639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:29.363571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:29.364593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 545/1089] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:29.369657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9135c-1a5f-4e21-b735-35f29e327f5f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.403910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:29.413653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff3965-918a-4e69-a893-fb35ec515dcd None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.452340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c6e47-97f0-4dba-a5b8-02a660a0bbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.452990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c6e47-97f0-4dba-a5b8-02a660a0bbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.453267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c6e47-97f0-4dba-a5b8-02a660a0bbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.453542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c6e47-97f0-4dba-a5b8-02a660a0bbb2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.466435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c6e47-97f0-4dba-a5b8-02a660a0bbb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-fd7c6e47-97f0-4dba-a5b8-02a660a0bbb2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:29.471027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:29.472123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:29.473000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 545/1090] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:29.473696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9135c-1a5f-4e21-b735-35f29e327f5f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.478099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c6e47-97f0-4dba-a5b8-02a660a0bbb2 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.500676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:29.506728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46da4a8-1057-4fdf-a118-1c1e415066a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.507327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46da4a8-1057-4fdf-a118-1c1e415066a6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.507604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46da4a8-1057-4fdf-a118-1c1e415066a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.507897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46da4a8-1057-4fdf-a118-1c1e415066a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.508550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46da4a8-1057-4fdf-a118-1c1e415066a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:29.508875 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46da4a8-1057-4fdf-a118-1c1e415066a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:29.510218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46da4a8-1057-4fdf-a118-1c1e415066a6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.519402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 546/1091] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:29.524770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46da4a8-1057-4fdf-a118-1c1e415066a6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.579617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c6e47-97f0-4dba-a5b8-02a660a0bbb2 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.612903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78267f4-9084-4bbb-aef1-071c318582f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.613439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78267f4-9084-4bbb-aef1-071c318582f9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.613719 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78267f4-9084-4bbb-aef1-071c318582f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.613988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78267f4-9084-4bbb-aef1-071c318582f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.614641 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78267f4-9084-4bbb-aef1-071c318582f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:29.615822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78267f4-9084-4bbb-aef1-071c318582f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:29.618722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78267f4-9084-4bbb-aef1-071c318582f9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.621247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:29.625230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46da4a8-1057-4fdf-a118-1c1e415066a6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.626242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 546/1092] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:29.631873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78267f4-9084-4bbb-aef1-071c318582f9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.660042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14a32-7630-463c-9167-d1237cf2ee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.660690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14a32-7630-463c-9167-d1237cf2ee6c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.660969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14a32-7630-463c-9167-d1237cf2ee6c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.661237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14a32-7630-463c-9167-d1237cf2ee6c None admin] PATH_INFO: `/v3/users/35efb3c0a4e74a8a87587f91035129b7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.662350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e14a32-7630-463c-9167-d1237cf2ee6c None admin] RBAC: Authorizing `identity:get_user(user_id=35efb3c0a4e74a8a87587f91035129b7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:29.663765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e14a32-7630-463c-9167-d1237cf2ee6c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.665366 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 547/1093] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/users/35efb3c0a4e74a8a87587f91035129b7 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:29.671046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14a32-7630-463c-9167-d1237cf2ee6c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.717847 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:29.736483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78267f4-9084-4bbb-aef1-071c318582f9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.768959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14a32-7630-463c-9167-d1237cf2ee6c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.769927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d4389-7524-4070-bcca-6fb3def82970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.770549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d4389-7524-4070-bcca-6fb3def82970 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.770824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d4389-7524-4070-bcca-6fb3def82970 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.771101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d4389-7524-4070-bcca-6fb3def82970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.781442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d4389-7524-4070-bcca-6fb3def82970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:29.782891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d4389-7524-4070-bcca-6fb3def82970 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-519d4389-7524-4070-bcca-6fb3def82970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:29.797293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:29.798309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:29.799461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:29.799461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:29.799461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:29.799461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 547/1094] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:29.804213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d4389-7524-4070-bcca-6fb3def82970 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.804396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71896e4-549b-4041-ba32-6038b1817a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.805465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71896e4-549b-4041-ba32-6038b1817a44 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.805748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71896e4-549b-4041-ba32-6038b1817a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.806020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71896e4-549b-4041-ba32-6038b1817a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.841411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:29.875593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71896e4-549b-4041-ba32-6038b1817a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:29.876990 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71896e4-549b-4041-ba32-6038b1817a44 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.904740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d4389-7524-4070-bcca-6fb3def82970 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.937869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05581550-35f8-4ba8-9424-cecdb9b5ce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.938542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05581550-35f8-4ba8-9424-cecdb9b5ce86 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.938908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05581550-35f8-4ba8-9424-cecdb9b5ce86 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.939251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05581550-35f8-4ba8-9424-cecdb9b5ce86 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.939884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05581550-35f8-4ba8-9424-cecdb9b5ce86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:29.940182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05581550-35f8-4ba8-9424-cecdb9b5ce86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:29.941571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05581550-35f8-4ba8-9424-cecdb9b5ce86 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.942956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:29.953592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 548/1095] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:29.959127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05581550-35f8-4ba8-9424-cecdb9b5ce86 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.976510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 548/1096] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 12:10:29.983434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71896e4-549b-4041-ba32-6038b1817a44 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.046918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.059414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05581550-35f8-4ba8-9424-cecdb9b5ce86 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.081910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71896e4-549b-4041-ba32-6038b1817a44 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.093823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc1079-d49f-4969-bacc-eb84c5454207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.094452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1079-d49f-4969-bacc-eb84c5454207 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.094723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1079-d49f-4969-bacc-eb84c5454207 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.094991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1079-d49f-4969-bacc-eb84c5454207 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.102271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc1079-d49f-4969-bacc-eb84c5454207 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.103701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc1079-d49f-4969-bacc-eb84c5454207 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-02fc1079-d49f-4969-bacc-eb84c5454207 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:30.115562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:30.116713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:30.117669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 549/1097] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:30.118945 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89867e9-3411-473a-9976-87ddebed7379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.119569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89867e9-3411-473a-9976-87ddebed7379 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.119841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89867e9-3411-473a-9976-87ddebed7379 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.120105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89867e9-3411-473a-9976-87ddebed7379 None admin] PATH_INFO: `/v3/projects/7e9893af6a024ae2bfb05cabdf47460c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.121487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89867e9-3411-473a-9976-87ddebed7379 None admin] RBAC: Authorizing `identity:get_project(project_id=7e9893af6a024ae2bfb05cabdf47460c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.122435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc1079-d49f-4969-bacc-eb84c5454207 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.122919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89867e9-3411-473a-9976-87ddebed7379 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.124679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 549/1098] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/projects/7e9893af6a024ae2bfb05cabdf47460c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:30.130299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89867e9-3411-473a-9976-87ddebed7379 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.177681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.223405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc1079-d49f-4969-bacc-eb84c5454207 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.228277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89867e9-3411-473a-9976-87ddebed7379 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.256648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e8bef-06c2-4cea-8ca5-c0af114ad9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.257265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e8bef-06c2-4cea-8ca5-c0af114ad9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.257545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e8bef-06c2-4cea-8ca5-c0af114ad9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.257817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e8bef-06c2-4cea-8ca5-c0af114ad9e3 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.258528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e8bef-06c2-4cea-8ca5-c0af114ad9e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:30.258829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e8bef-06c2-4cea-8ca5-c0af114ad9e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.260251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e8bef-06c2-4cea-8ca5-c0af114ad9e3 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.263081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1a780-fbcc-4e47-8b17-da681dd60bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.264399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1a780-fbcc-4e47-8b17-da681dd60bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.264717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1a780-fbcc-4e47-8b17-da681dd60bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.264983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1a780-fbcc-4e47-8b17-da681dd60bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.265703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1a780-fbcc-4e47-8b17-da681dd60bf0 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=7e9893af6a024ae2bfb05cabdf47460c, user.id=35efb3c0a4e74a8a87587f91035129b7) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:30.266011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1a780-fbcc-4e47-8b17-da681dd60bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.268023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1a780-fbcc-4e47-8b17-da681dd60bf0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.270790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.275733 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 550/1099] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/role_assignments?user.id=35efb3c0a4e74a8a87587f91035129b7&scope.project.id=7e9893af6a024ae2bfb05cabdf47460c&role.id=d6155b01aace49f887f29aa2861d31cf => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:30.283119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 550/1100] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:30.284494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1a780-fbcc-4e47-8b17-da681dd60bf0 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.392239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1a780-fbcc-4e47-8b17-da681dd60bf0 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.429751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b96e7f-3bd9-46b2-9d65-03ab9e9868a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.430360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96e7f-3bd9-46b2-9d65-03ab9e9868a0 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.430638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96e7f-3bd9-46b2-9d65-03ab9e9868a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.430905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96e7f-3bd9-46b2-9d65-03ab9e9868a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.495051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.499078 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b96e7f-3bd9-46b2-9d65-03ab9e9868a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.500730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b96e7f-3bd9-46b2-9d65-03ab9e9868a0 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.596521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 551/1101] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:30.602424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e8bef-06c2-4cea-8ca5-c0af114ad9e3 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.701563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e8bef-06c2-4cea-8ca5-c0af114ad9e3 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.714267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.735260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5fd51-dea2-4454-b8f4-dc25f8e72e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.735882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5fd51-dea2-4454-b8f4-dc25f8e72e05 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.736157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5fd51-dea2-4454-b8f4-dc25f8e72e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.736425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5fd51-dea2-4454-b8f4-dc25f8e72e05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.746197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5fd51-dea2-4454-b8f4-dc25f8e72e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.748225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5fd51-dea2-4454-b8f4-dc25f8e72e05 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-b4e5fd51-dea2-4454-b8f4-dc25f8e72e05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:30.762942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:30.763895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:30.764828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:30.764828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:30.764828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:30.764828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 551/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:30.769815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b96e7f-3bd9-46b2-9d65-03ab9e9868a0 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.864756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.868739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b96e7f-3bd9-46b2-9d65-03ab9e9868a0 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.901768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dda1b-b170-4a1d-9595-268130a54a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.902364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dda1b-b170-4a1d-9595-268130a54a67 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.902639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dda1b-b170-4a1d-9595-268130a54a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.903467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dda1b-b170-4a1d-9595-268130a54a67 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.904120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dda1b-b170-4a1d-9595-268130a54a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:30.904418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dda1b-b170-4a1d-9595-268130a54a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.905802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dda1b-b170-4a1d-9595-268130a54a67 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.916569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 552/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:30.922901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5fd51-dea2-4454-b8f4-dc25f8e72e05 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.030342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5fd51-dea2-4454-b8f4-dc25f8e72e05 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.062582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501612e6-960c-45fd-a40a-33f30b531e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.063202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501612e6-960c-45fd-a40a-33f30b531e04 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.063475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501612e6-960c-45fd-a40a-33f30b531e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.063742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501612e6-960c-45fd-a40a-33f30b531e04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.070208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501612e6-960c-45fd-a40a-33f30b531e04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.071626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501612e6-960c-45fd-a40a-33f30b531e04 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-501612e6-960c-45fd-a40a-33f30b531e04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:31.083040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:31.084239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:31.085174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:31.085174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:31.085174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:31.085174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:31.085174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:31.085174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:31.085174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:31.085174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:31.085174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 552/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:31.090062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dda1b-b170-4a1d-9595-268130a54a67 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.186896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dda1b-b170-4a1d-9595-268130a54a67 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.220722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84e661-33b1-48a3-a180-dc1c4887ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.221315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e661-33b1-48a3-a180-dc1c4887ad7c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.221600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e661-33b1-48a3-a180-dc1c4887ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.221869 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e661-33b1-48a3-a180-dc1c4887ad7c None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.222546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84e661-33b1-48a3-a180-dc1c4887ad7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:31.222847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84e661-33b1-48a3-a180-dc1c4887ad7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.224259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84e661-33b1-48a3-a180-dc1c4887ad7c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.235929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 553/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:31.241798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501612e6-960c-45fd-a40a-33f30b531e04 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.267278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:31.342007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501612e6-960c-45fd-a40a-33f30b531e04 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.377468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719bb88-8979-49d7-b04e-231607be96cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.378063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719bb88-8979-49d7-b04e-231607be96cb None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.378334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719bb88-8979-49d7-b04e-231607be96cb None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.378602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719bb88-8979-49d7-b04e-231607be96cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.379314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719bb88-8979-49d7-b04e-231607be96cb None admin] RBAC: Adding query filter params (role.id=b6c2fce401ec4816aae2928181962c37, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=98925192a33544e081f1a02faed60b7f) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:31.379616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719bb88-8979-49d7-b04e-231607be96cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.381071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719bb88-8979-49d7-b04e-231607be96cb None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.386808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 553/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/role_assignments?user.id=98925192a33544e081f1a02faed60b7f&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=b6c2fce401ec4816aae2928181962c37 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:32.404272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288937c-477a-4819-8a49-cb6810d48f60 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:32.404831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288937c-477a-4819-8a49-cb6810d48f60 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:32.404831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288937c-477a-4819-8a49-cb6810d48f60 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:32.406395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 554/1107] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:32.411555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8ca5-c005-483d-9d7d-7649745ead04 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:32.411975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8ca5-c005-483d-9d7d-7649745ead04 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:32.412094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8ca5-c005-483d-9d7d-7649745ead04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:32.430806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-3a0a8ca5-c005-483d-9d7d-7649745ead04 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:32.431983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3a0a8ca5-c005-483d-9d7d-7649745ead04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:32.498353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 554/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:32.522762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288937c-477a-4819-8a49-cb6810d48f60 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:32.542821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:32.626131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288937c-477a-4819-8a49-cb6810d48f60 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:32.660053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b97e2-a995-46df-a38e-6982d18f9d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:32.660599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b97e2-a995-46df-a38e-6982d18f9d3d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:32.660907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b97e2-a995-46df-a38e-6982d18f9d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:32.661174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b97e2-a995-46df-a38e-6982d18f9d3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:32.662271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b97e2-a995-46df-a38e-6982d18f9d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:32.663684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b97e2-a995-46df-a38e-6982d18f9d3d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:32.665282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 555/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:32.671106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a8ca5-c005-483d-9d7d-7649745ead04 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:32.689341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:32.769249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a8ca5-c005-483d-9d7d-7649745ead04 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:32.801776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b735a-65b1-4304-a055-a7c8ceea3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:32.802364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b735a-65b1-4304-a055-a7c8ceea3cda None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:32.802636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b735a-65b1-4304-a055-a7c8ceea3cda None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:32.802900 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b735a-65b1-4304-a055-a7c8ceea3cda None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:32.803530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b735a-65b1-4304-a055-a7c8ceea3cda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:32.804981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b735a-65b1-4304-a055-a7c8ceea3cda None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:32.824218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 555/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:10:32 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:34.917508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf9727-e305-4bfa-85f9-ddec51a5b79a None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.918030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf9727-e305-4bfa-85f9-ddec51a5b79a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.918030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf9727-e305-4bfa-85f9-ddec51a5b79a None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.920373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 556/1111] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:34.925851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c1dd2-61c7-4b55-88ef-2de4207956c6 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.926237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c1dd2-61c7-4b55-88ef-2de4207956c6 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.926394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c1dd2-61c7-4b55-88ef-2de4207956c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.945248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-624c1dd2-61c7-4b55-88ef-2de4207956c6 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:34.947271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-624c1dd2-61c7-4b55-88ef-2de4207956c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:35.015986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 556/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:35.040833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf9727-e305-4bfa-85f9-ddec51a5b79a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.126906 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:35.142950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf9727-e305-4bfa-85f9-ddec51a5b79a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.177150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91506783-9766-4e7f-bb86-31cf2289032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.177705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91506783-9766-4e7f-bb86-31cf2289032c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.177983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91506783-9766-4e7f-bb86-31cf2289032c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.178251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91506783-9766-4e7f-bb86-31cf2289032c None admin] PATH_INFO: `/v3/roles/c6822f728eca477f81827dcc4c547bd0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.179635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91506783-9766-4e7f-bb86-31cf2289032c None admin] RBAC: Authorizing `identity:get_role(role_id=c6822f728eca477f81827dcc4c547bd0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.181026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91506783-9766-4e7f-bb86-31cf2289032c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.182363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 557/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/roles/c6822f728eca477f81827dcc4c547bd0 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:35.188416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c1dd2-61c7-4b55-88ef-2de4207956c6 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.191494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:35.292459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c1dd2-61c7-4b55-88ef-2de4207956c6 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.330060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231a23-d4aa-4741-ae89-48689a197376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.330675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231a23-d4aa-4741-ae89-48689a197376 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.330948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231a23-d4aa-4741-ae89-48689a197376 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.331216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231a23-d4aa-4741-ae89-48689a197376 None admin] PATH_INFO: `/v3/users/f017a44b03294afd8197cf13e0ce09c8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.344298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea231a23-d4aa-4741-ae89-48689a197376 None admin] RBAC: Authorizing `identity:get_user(user_id=f017a44b03294afd8197cf13e0ce09c8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.345745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea231a23-d4aa-4741-ae89-48689a197376 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.347335 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 557/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/users/f017a44b03294afd8197cf13e0ce09c8 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:35.353155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91506783-9766-4e7f-bb86-31cf2289032c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.453712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91506783-9766-4e7f-bb86-31cf2289032c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.486986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ae53-1ac9-43e0-9a4e-883d2ead3928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.487581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ae53-1ac9-43e0-9a4e-883d2ead3928 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.487852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ae53-1ac9-43e0-9a4e-883d2ead3928 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.488115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ae53-1ac9-43e0-9a4e-883d2ead3928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.510659 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:35.554084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8ae53-1ac9-43e0-9a4e-883d2ead3928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.555506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8ae53-1ac9-43e0-9a4e-883d2ead3928 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.657839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 558/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:35.663738 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231a23-d4aa-4741-ae89-48689a197376 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.723852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:35.761595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231a23-d4aa-4741-ae89-48689a197376 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.795004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b6333-1c02-4208-ab4d-bef9d656e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.795623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b6333-1c02-4208-ab4d-bef9d656e646 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.795897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b6333-1c02-4208-ab4d-bef9d656e646 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.796166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b6333-1c02-4208-ab4d-bef9d656e646 None admin] PATH_INFO: `/v3/projects/7e9893af6a024ae2bfb05cabdf47460c` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.797280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b6333-1c02-4208-ab4d-bef9d656e646 None admin] RBAC: Authorizing `identity:get_project(project_id=7e9893af6a024ae2bfb05cabdf47460c)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.798951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b6333-1c02-4208-ab4d-bef9d656e646 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.800581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 558/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/projects/7e9893af6a024ae2bfb05cabdf47460c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:35.806719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ae53-1ac9-43e0-9a4e-883d2ead3928 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.865366 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:35.908968 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ae53-1ac9-43e0-9a4e-883d2ead3928 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.941987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138d183-e79e-41d1-baeb-09f4c5eaa4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.942590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d183-e79e-41d1-baeb-09f4c5eaa4cb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.942833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d183-e79e-41d1-baeb-09f4c5eaa4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.943103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d183-e79e-41d1-baeb-09f4c5eaa4cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.943814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138d183-e79e-41d1-baeb-09f4c5eaa4cb None admin] RBAC: Adding query filter params (role.id=c6822f728eca477f81827dcc4c547bd0, scope.project.id=7e9893af6a024ae2bfb05cabdf47460c, user.id=f017a44b03294afd8197cf13e0ce09c8) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:35.944117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138d183-e79e-41d1-baeb-09f4c5eaa4cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.945553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138d183-e79e-41d1-baeb-09f4c5eaa4cb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.952324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 559/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/role_assignments?user.id=f017a44b03294afd8197cf13e0ce09c8&scope.project.id=7e9893af6a024ae2bfb05cabdf47460c&role.id=c6822f728eca477f81827dcc4c547bd0 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:37.962195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e264be9-dd2a-49fb-aaab-22056a3a7b7e None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:37.962773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e264be9-dd2a-49fb-aaab-22056a3a7b7e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:37.962773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e264be9-dd2a-49fb-aaab-22056a3a7b7e None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:37.964078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 559/1118] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:37.969131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa90ba-21b7-40a2-883d-8e4077154a41 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:37.969563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa90ba-21b7-40a2-883d-8e4077154a41 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:37.969671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa90ba-21b7-40a2-883d-8e4077154a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:37.987838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a4aa90ba-21b7-40a2-883d-8e4077154a41 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:37.989050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a4aa90ba-21b7-40a2-883d-8e4077154a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:38.054009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 560/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:38.076744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e264be9-dd2a-49fb-aaab-22056a3a7b7e None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:38.174956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e264be9-dd2a-49fb-aaab-22056a3a7b7e None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:38.201978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:38.207891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea052ddc-4232-4aa8-83b0-90d844c212ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:38.208503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea052ddc-4232-4aa8-83b0-90d844c212ae None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.208806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea052ddc-4232-4aa8-83b0-90d844c212ae None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.209078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea052ddc-4232-4aa8-83b0-90d844c212ae None admin] PATH_INFO: `/v3/roles/c6822f728eca477f81827dcc4c547bd0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.210445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea052ddc-4232-4aa8-83b0-90d844c212ae None admin] RBAC: Authorizing `identity:get_role(role_id=c6822f728eca477f81827dcc4c547bd0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:38.211801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea052ddc-4232-4aa8-83b0-90d844c212ae None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:38.213185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 560/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:38 2022] GET /identity/v3/roles/c6822f728eca477f81827dcc4c547bd0 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:38.219713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa90ba-21b7-40a2-883d-8e4077154a41 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:38.266846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:38.316849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa90ba-21b7-40a2-883d-8e4077154a41 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:38.349588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a118f2-8ed0-467f-9ca5-497af2d061e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:38.350204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a118f2-8ed0-467f-9ca5-497af2d061e1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.350480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a118f2-8ed0-467f-9ca5-497af2d061e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.350749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a118f2-8ed0-467f-9ca5-497af2d061e1 None admin] PATH_INFO: `/v3/users/f017a44b03294afd8197cf13e0ce09c8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.351853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a118f2-8ed0-467f-9ca5-497af2d061e1 None admin] RBAC: Authorizing `identity:get_user(user_id=f017a44b03294afd8197cf13e0ce09c8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:38.353321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a118f2-8ed0-467f-9ca5-497af2d061e1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:38.354884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 561/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:38 2022] GET /identity/v3/users/f017a44b03294afd8197cf13e0ce09c8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:38.361387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea052ddc-4232-4aa8-83b0-90d844c212ae None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:38.457951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea052ddc-4232-4aa8-83b0-90d844c212ae None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:38.491909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bf421-ea0e-4674-9f96-b3d226732a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:38.492460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bf421-ea0e-4674-9f96-b3d226732a9d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.492777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bf421-ea0e-4674-9f96-b3d226732a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.493046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bf421-ea0e-4674-9f96-b3d226732a9d None admin] PATH_INFO: `/v3/projects/7e9893af6a024ae2bfb05cabdf47460c` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.494146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bf421-ea0e-4674-9f96-b3d226732a9d None admin] RBAC: Authorizing `identity:get_project(project_id=7e9893af6a024ae2bfb05cabdf47460c)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:38.495560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bf421-ea0e-4674-9f96-b3d226732a9d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:38.497228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 561/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:38 2022] GET /identity/v3/projects/7e9893af6a024ae2bfb05cabdf47460c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:38.503335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a118f2-8ed0-467f-9ca5-497af2d061e1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:38.598581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a118f2-8ed0-467f-9ca5-497af2d061e1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:38.614057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:38.631263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936f6c0-8ac9-47a8-b74f-1955282c5594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:38.631898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936f6c0-8ac9-47a8-b74f-1955282c5594 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.632174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936f6c0-8ac9-47a8-b74f-1955282c5594 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.632444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936f6c0-8ac9-47a8-b74f-1955282c5594 None admin] PATH_INFO: `/v3/projects/7e9893af6a024ae2bfb05cabdf47460c/users/f017a44b03294afd8197cf13e0ce09c8/roles/c6822f728eca477f81827dcc4c547bd0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.634569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936f6c0-8ac9-47a8-b74f-1955282c5594 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e9893af6a024ae2bfb05cabdf47460c, user_id=f017a44b03294afd8197cf13e0ce09c8, role_id=c6822f728eca477f81827dcc4c547bd0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:38.635977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936f6c0-8ac9-47a8-b74f-1955282c5594 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:38.648316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 562/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:38 2022] PUT /identity/v3/projects/7e9893af6a024ae2bfb05cabdf47460c/users/f017a44b03294afd8197cf13e0ce09c8/roles/c6822f728eca477f81827dcc4c547bd0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:10:40.663063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65d6b-e1fa-4db4-80d6-4c8d31ffa051 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.663636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65d6b-e1fa-4db4-80d6-4c8d31ffa051 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.663636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65d6b-e1fa-4db4-80d6-4c8d31ffa051 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.664990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 562/1124] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:40.670928 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785583e-f702-430d-a220-266dccf79f74 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.671358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785583e-f702-430d-a220-266dccf79f74 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.671456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785583e-f702-430d-a220-266dccf79f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.689334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0785583e-f702-430d-a220-266dccf79f74 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:40.690512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0785583e-f702-430d-a220-266dccf79f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:40.754967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 563/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:40.779341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b65d6b-e1fa-4db4-80d6-4c8d31ffa051 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:40.844602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:40.879815 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b65d6b-e1fa-4db4-80d6-4c8d31ffa051 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:40.911921 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7bc1-df00-4337-a15c-fb2c633070e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:40.912535 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7bc1-df00-4337-a15c-fb2c633070e0 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.912838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7bc1-df00-4337-a15c-fb2c633070e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.913107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7bc1-df00-4337-a15c-fb2c633070e0 None admin] PATH_INFO: `/v3/roles/c6822f728eca477f81827dcc4c547bd0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.914481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7bc1-df00-4337-a15c-fb2c633070e0 None admin] RBAC: Authorizing `identity:get_role(role_id=c6822f728eca477f81827dcc4c547bd0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:40.915841 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7bc1-df00-4337-a15c-fb2c633070e0 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:40.917202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 563/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:40 2022] GET /identity/v3/roles/c6822f728eca477f81827dcc4c547bd0 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:40.923847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785583e-f702-430d-a220-266dccf79f74 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:41.018627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785583e-f702-430d-a220-266dccf79f74 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:41.025563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:41.053095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc79b6-9e09-4b08-94d6-062e4723f292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:41.054110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc79b6-9e09-4b08-94d6-062e4723f292 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:41.054594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc79b6-9e09-4b08-94d6-062e4723f292 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:41.055075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc79b6-9e09-4b08-94d6-062e4723f292 None admin] PATH_INFO: `/v3/users/f017a44b03294afd8197cf13e0ce09c8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:41.057007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc79b6-9e09-4b08-94d6-062e4723f292 None admin] RBAC: Authorizing `identity:get_user(user_id=f017a44b03294afd8197cf13e0ce09c8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:41.060269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc79b6-9e09-4b08-94d6-062e4723f292 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:41.063342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 564/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:40 2022] GET /identity/v3/users/f017a44b03294afd8197cf13e0ce09c8 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:41.069669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7bc1-df00-4337-a15c-fb2c633070e0 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:41.166071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7bc1-df00-4337-a15c-fb2c633070e0 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:41.199502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5e42-a17d-4a05-89a8-9b35546e18de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:41.200036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5e42-a17d-4a05-89a8-9b35546e18de None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:41.200311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5e42-a17d-4a05-89a8-9b35546e18de None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:41.200577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5e42-a17d-4a05-89a8-9b35546e18de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:41.203105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:41.266166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a5e42-a17d-4a05-89a8-9b35546e18de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:41.267595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a5e42-a17d-4a05-89a8-9b35546e18de None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:41.363819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 564/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:41.369738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc79b6-9e09-4b08-94d6-062e4723f292 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:41.466539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc79b6-9e09-4b08-94d6-062e4723f292 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:41.498983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdf6e3-44ca-41b5-a819-2355cc2f1148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:41.499603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdf6e3-44ca-41b5-a819-2355cc2f1148 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:41.499880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdf6e3-44ca-41b5-a819-2355cc2f1148 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:41.500150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdf6e3-44ca-41b5-a819-2355cc2f1148 None admin] PATH_INFO: `/v3/projects/7e9893af6a024ae2bfb05cabdf47460c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:41.501277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdf6e3-44ca-41b5-a819-2355cc2f1148 None admin] RBAC: Authorizing `identity:get_project(project_id=7e9893af6a024ae2bfb05cabdf47460c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:41.502696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdf6e3-44ca-41b5-a819-2355cc2f1148 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:41.504314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 565/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:41 2022] GET /identity/v3/projects/7e9893af6a024ae2bfb05cabdf47460c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:41.510409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5e42-a17d-4a05-89a8-9b35546e18de None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:41.543747 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:41.608575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5e42-a17d-4a05-89a8-9b35546e18de None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:41.641579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc8466-4db9-404b-8688-15a98151f151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:41.642161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8466-4db9-404b-8688-15a98151f151 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:41.642438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8466-4db9-404b-8688-15a98151f151 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:41.642706 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8466-4db9-404b-8688-15a98151f151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:41.643414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc8466-4db9-404b-8688-15a98151f151 None admin] RBAC: Adding query filter params (role.id=c6822f728eca477f81827dcc4c547bd0, scope.project.id=7e9893af6a024ae2bfb05cabdf47460c, user.id=f017a44b03294afd8197cf13e0ce09c8) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:41.643719 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc8466-4db9-404b-8688-15a98151f151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:41.645174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc8466-4db9-404b-8688-15a98151f151 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:41.650819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 565/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:41 2022] GET /identity/v3/role_assignments?user.id=f017a44b03294afd8197cf13e0ce09c8&scope.project.id=7e9893af6a024ae2bfb05cabdf47460c&role.id=c6822f728eca477f81827dcc4c547bd0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:43.667593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c5d6-b84c-4649-9cc4-13fb462f6aae None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.668810 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c5d6-b84c-4649-9cc4-13fb462f6aae None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.668810 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6c5d6-b84c-4649-9cc4-13fb462f6aae None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.670138 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 566/1131] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:43.675557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af362c-1c0f-458b-8e87-c519481a92dc None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.675994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af362c-1c0f-458b-8e87-c519481a92dc None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.676107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af362c-1c0f-458b-8e87-c519481a92dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.693599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-03af362c-1c0f-458b-8e87-c519481a92dc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:43.694764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-03af362c-1c0f-458b-8e87-c519481a92dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:43.760640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 566/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:43.784204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6c5d6-b84c-4649-9cc4-13fb462f6aae None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:43.827359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:43.882340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6c5d6-b84c-4649-9cc4-13fb462f6aae None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:43.914967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8abf23-284d-4f87-812f-b1c7954dca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:43.915578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8abf23-284d-4f87-812f-b1c7954dca94 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.915851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8abf23-284d-4f87-812f-b1c7954dca94 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.916116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8abf23-284d-4f87-812f-b1c7954dca94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.917205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8abf23-284d-4f87-812f-b1c7954dca94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:43.918730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8abf23-284d-4f87-812f-b1c7954dca94 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:43.920322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 567/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:43.926335 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af362c-1c0f-458b-8e87-c519481a92dc None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:43.953428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:44.024036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af362c-1c0f-458b-8e87-c519481a92dc None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.057191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684cc8a-2f34-472d-809d-ee55edbb6b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.057784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684cc8a-2f34-472d-809d-ee55edbb6b63 None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.058061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684cc8a-2f34-472d-809d-ee55edbb6b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.058329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684cc8a-2f34-472d-809d-ee55edbb6b63 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.059088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684cc8a-2f34-472d-809d-ee55edbb6b63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.060511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684cc8a-2f34-472d-809d-ee55edbb6b63 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.087613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 567/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:43 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:46.111274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94c026-859a-42d9-8f01-edad3aafe205 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.111828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94c026-859a-42d9-8f01-edad3aafe205 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.111828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94c026-859a-42d9-8f01-edad3aafe205 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.113187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 568/1135] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:46.118404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8618e-b7c8-4be9-a8e2-3bfbd1e9e37c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.118832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8618e-b7c8-4be9-a8e2-3bfbd1e9e37c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.118934 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8618e-b7c8-4be9-a8e2-3bfbd1e9e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.137159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-f5e8618e-b7c8-4be9-a8e2-3bfbd1e9e37c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:46.138310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f5e8618e-b7c8-4be9-a8e2-3bfbd1e9e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:46.202727 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 568/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:46.226655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94c026-859a-42d9-8f01-edad3aafe205 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:46.325176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94c026-859a-42d9-8f01-edad3aafe205 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:46.335318 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:46.358637 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d1f2f-aba7-4a37-be8e-699895450d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:46.359250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d1f2f-aba7-4a37-be8e-699895450d0c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.359524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d1f2f-aba7-4a37-be8e-699895450d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.359789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d1f2f-aba7-4a37-be8e-699895450d0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.360926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d1f2f-aba7-4a37-be8e-699895450d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:46.362396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d1f2f-aba7-4a37-be8e-699895450d0c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:46.363897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 569/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:46.369511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8618e-b7c8-4be9-a8e2-3bfbd1e9e37c None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:46.381348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:46.468613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8618e-b7c8-4be9-a8e2-3bfbd1e9e37c None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:46.501515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b9eea-7111-4eb7-b3c1-4f043c7a8e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:46.502099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9eea-7111-4eb7-b3c1-4f043c7a8e0f None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.502373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9eea-7111-4eb7-b3c1-4f043c7a8e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.502634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9eea-7111-4eb7-b3c1-4f043c7a8e0f None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.503265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b9eea-7111-4eb7-b3c1-4f043c7a8e0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:46.504700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b9eea-7111-4eb7-b3c1-4f043c7a8e0f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:46.525670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 569/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:10:46 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:48.612722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd62a39-53d9-4b11-98ab-addde6fb1731 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.613239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd62a39-53d9-4b11-98ab-addde6fb1731 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.613239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd62a39-53d9-4b11-98ab-addde6fb1731 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.614579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 570/1139] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:48.619776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6019ae-fa5c-4d82-8f9c-25e4064d3463 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.620154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6019ae-fa5c-4d82-8f9c-25e4064d3463 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.620322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6019ae-fa5c-4d82-8f9c-25e4064d3463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.638755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ad6019ae-fa5c-4d82-8f9c-25e4064d3463 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:48.639927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ad6019ae-fa5c-4d82-8f9c-25e4064d3463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:48.697793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:48.705967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 570/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:48.728848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd62a39-53d9-4b11-98ab-addde6fb1731 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:48.827966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd62a39-53d9-4b11-98ab-addde6fb1731 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:48.860180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a41b89-fcdf-4a9b-975c-189880c4ed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:48.860819 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a41b89-fcdf-4a9b-975c-189880c4ed70 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.861092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a41b89-fcdf-4a9b-975c-189880c4ed70 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.861355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a41b89-fcdf-4a9b-975c-189880c4ed70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.871379 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a41b89-fcdf-4a9b-975c-189880c4ed70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-c9a41b89-fcdf-4a9b-975c-189880c4ed70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:48.876187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:48.877470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:48.878392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 571/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:48.883110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6019ae-fa5c-4d82-8f9c-25e4064d3463 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:48.979199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6019ae-fa5c-4d82-8f9c-25e4064d3463 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.012565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbfc65-aceb-4b3f-a835-4ea0c9ca5bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.013179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbfc65-aceb-4b3f-a835-4ea0c9ca5bca None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.013452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbfc65-aceb-4b3f-a835-4ea0c9ca5bca None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.013716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbfc65-aceb-4b3f-a835-4ea0c9ca5bca None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.014356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbfc65-aceb-4b3f-a835-4ea0c9ca5bca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:49.014687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbfc65-aceb-4b3f-a835-4ea0c9ca5bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.016043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbfc65-aceb-4b3f-a835-4ea0c9ca5bca None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.023690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 571/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:49.029371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a41b89-fcdf-4a9b-975c-189880c4ed70 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.068830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.126991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a41b89-fcdf-4a9b-975c-189880c4ed70 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.159719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04d959-12d7-4122-851a-1557fd7865f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.160330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d959-12d7-4122-851a-1557fd7865f1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.160601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d959-12d7-4122-851a-1557fd7865f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.160893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d959-12d7-4122-851a-1557fd7865f1 None admin] PATH_INFO: `/v3/users/2e5337695c654d768b47c5cfd6f65117` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.174100 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04d959-12d7-4122-851a-1557fd7865f1 None admin] RBAC: Authorizing `identity:get_user(user_id=2e5337695c654d768b47c5cfd6f65117)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.175508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04d959-12d7-4122-851a-1557fd7865f1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.177112 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 572/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:49 2022] GET /identity/v3/users/2e5337695c654d768b47c5cfd6f65117 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:49.182870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbfc65-aceb-4b3f-a835-4ea0c9ca5bca None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.240185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.281564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbfc65-aceb-4b3f-a835-4ea0c9ca5bca None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.313670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea987cb-a36b-41c2-94c5-69ff99ae2801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.314257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea987cb-a36b-41c2-94c5-69ff99ae2801 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.314528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea987cb-a36b-41c2-94c5-69ff99ae2801 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.314793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea987cb-a36b-41c2-94c5-69ff99ae2801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.380018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea987cb-a36b-41c2-94c5-69ff99ae2801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.381482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea987cb-a36b-41c2-94c5-69ff99ae2801 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.435797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.476720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 572/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:49.482570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04d959-12d7-4122-851a-1557fd7865f1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.573258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.579749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04d959-12d7-4122-851a-1557fd7865f1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.612177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60323183-055b-4fe9-9ee6-42647f16b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.612821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60323183-055b-4fe9-9ee6-42647f16b10a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.613349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60323183-055b-4fe9-9ee6-42647f16b10a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.613349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60323183-055b-4fe9-9ee6-42647f16b10a None admin] PATH_INFO: `/v3/projects/11178e571e5e4b83ba390219968027d6` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.614438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60323183-055b-4fe9-9ee6-42647f16b10a None admin] RBAC: Authorizing `identity:get_project(project_id=11178e571e5e4b83ba390219968027d6)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.615848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60323183-055b-4fe9-9ee6-42647f16b10a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.617487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 573/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:49 2022] GET /identity/v3/projects/11178e571e5e4b83ba390219968027d6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:49.624150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea987cb-a36b-41c2-94c5-69ff99ae2801 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.721260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea987cb-a36b-41c2-94c5-69ff99ae2801 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.754518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de5841-88c8-4a86-a768-da7c60546954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.755106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de5841-88c8-4a86-a768-da7c60546954 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.755384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de5841-88c8-4a86-a768-da7c60546954 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.755652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de5841-88c8-4a86-a768-da7c60546954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.756362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de5841-88c8-4a86-a768-da7c60546954 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=11178e571e5e4b83ba390219968027d6, user.id=2e5337695c654d768b47c5cfd6f65117) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:49.756692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de5841-88c8-4a86-a768-da7c60546954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.758110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de5841-88c8-4a86-a768-da7c60546954 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.763374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 573/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:49 2022] GET /identity/v3/role_assignments?user.id=2e5337695c654d768b47c5cfd6f65117&scope.project.id=11178e571e5e4b83ba390219968027d6&role.id=d6155b01aace49f887f29aa2861d31cf => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:51.732375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c553f-f018-4aee-8702-71d83c8aeeb1 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:51.732924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c553f-f018-4aee-8702-71d83c8aeeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:51.732924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c553f-f018-4aee-8702-71d83c8aeeb1 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:51.734213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 574/1147] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:51.739474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7356-b6d0-4f1a-abfc-ef0d470de01c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:51.739892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7356-b6d0-4f1a-abfc-ef0d470de01c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:51.740024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7356-b6d0-4f1a-abfc-ef0d470de01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:51.758139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-6c4b7356-b6d0-4f1a-abfc-ef0d470de01c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:51.759310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-6c4b7356-b6d0-4f1a-abfc-ef0d470de01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:51.775950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:51.825944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 574/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:51.848036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c553f-f018-4aee-8702-71d83c8aeeb1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:51.945892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c553f-f018-4aee-8702-71d83c8aeeb1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:51.978222 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc2a68-2e7e-4d69-91ab-800bc5eb9293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:51.978827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2a68-2e7e-4d69-91ab-800bc5eb9293 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:51.979103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2a68-2e7e-4d69-91ab-800bc5eb9293 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:51.979366 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2a68-2e7e-4d69-91ab-800bc5eb9293 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:51.989586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc2a68-2e7e-4d69-91ab-800bc5eb9293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-51bc2a68-2e7e-4d69-91ab-800bc5eb9293 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:51.994065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:51.995154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:51.996840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 575/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:52.001759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7356-b6d0-4f1a-abfc-ef0d470de01c None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.098650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7356-b6d0-4f1a-abfc-ef0d470de01c None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.132273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1bcfa-c4f4-4253-9ee6-8af976aca36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.132890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1bcfa-c4f4-4253-9ee6-8af976aca36d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.133168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1bcfa-c4f4-4253-9ee6-8af976aca36d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.133433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1bcfa-c4f4-4253-9ee6-8af976aca36d None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.134078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1bcfa-c4f4-4253-9ee6-8af976aca36d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:52.134375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1bcfa-c4f4-4253-9ee6-8af976aca36d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.135727 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1bcfa-c4f4-4253-9ee6-8af976aca36d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.143506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 575/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:52.149568 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc2a68-2e7e-4d69-91ab-800bc5eb9293 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.186289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.258485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc2a68-2e7e-4d69-91ab-800bc5eb9293 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.290713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b318e-0c35-462c-a523-f39a10479a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.291333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b318e-0c35-462c-a523-f39a10479a78 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.291609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b318e-0c35-462c-a523-f39a10479a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.291879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b318e-0c35-462c-a523-f39a10479a78 None admin] PATH_INFO: `/v3/users/2e5337695c654d768b47c5cfd6f65117` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.293530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b318e-0c35-462c-a523-f39a10479a78 None admin] RBAC: Authorizing `identity:get_user(user_id=2e5337695c654d768b47c5cfd6f65117)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.294941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b318e-0c35-462c-a523-f39a10479a78 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.296516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 576/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/users/2e5337695c654d768b47c5cfd6f65117 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:52.302578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1bcfa-c4f4-4253-9ee6-8af976aca36d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.318903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.400459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1bcfa-c4f4-4253-9ee6-8af976aca36d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.434741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5917a92-2fa7-4123-afab-042fb676e90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.435353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5917a92-2fa7-4123-afab-042fb676e90b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.435627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5917a92-2fa7-4123-afab-042fb676e90b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.435891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5917a92-2fa7-4123-afab-042fb676e90b None admin] PATH_INFO: `/v3/projects/11178e571e5e4b83ba390219968027d6` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.437006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5917a92-2fa7-4123-afab-042fb676e90b None admin] RBAC: Authorizing `identity:get_project(project_id=11178e571e5e4b83ba390219968027d6)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.438417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5917a92-2fa7-4123-afab-042fb676e90b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.440031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 576/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/projects/11178e571e5e4b83ba390219968027d6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:52.445930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b318e-0c35-462c-a523-f39a10479a78 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.534612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.544442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b318e-0c35-462c-a523-f39a10479a78 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.577090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ae80c-64a6-486b-b74b-48f7cfca7167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.577724 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ae80c-64a6-486b-b74b-48f7cfca7167 None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.577997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ae80c-64a6-486b-b74b-48f7cfca7167 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.578264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ae80c-64a6-486b-b74b-48f7cfca7167 None admin] PATH_INFO: `/v3/projects/11178e571e5e4b83ba390219968027d6/users/2e5337695c654d768b47c5cfd6f65117/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.580110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ae80c-64a6-486b-b74b-48f7cfca7167 None admin] RBAC: Authorizing `identity:create_grant(project_id=11178e571e5e4b83ba390219968027d6, user_id=2e5337695c654d768b47c5cfd6f65117, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.581543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ae80c-64a6-486b-b74b-48f7cfca7167 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.594670 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 577/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:52 2022] PUT /identity/v3/projects/11178e571e5e4b83ba390219968027d6/users/2e5337695c654d768b47c5cfd6f65117/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:10:54.608936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7896-1edd-497c-a849-a7bc1a08e33e None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:54.609463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7896-1edd-497c-a849-a7bc1a08e33e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:54.609463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7896-1edd-497c-a849-a7bc1a08e33e None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:54.610832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 577/1154] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:54.616143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38651-f252-4f72-8430-b5d680d78404 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:54.616605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38651-f252-4f72-8430-b5d680d78404 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:54.616725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38651-f252-4f72-8430-b5d680d78404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:54.634631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4ab38651-f252-4f72-8430-b5d680d78404 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:54.635791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4ab38651-f252-4f72-8430-b5d680d78404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:54.700951 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 578/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:54.723738 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7896-1edd-497c-a849-a7bc1a08e33e None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:54.805236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:54.825273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7896-1edd-497c-a849-a7bc1a08e33e None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:54.857481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3170ad-925d-4da3-8fce-919265a5e6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:54.858094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3170ad-925d-4da3-8fce-919265a5e6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:54.858372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3170ad-925d-4da3-8fce-919265a5e6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:54.858642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3170ad-925d-4da3-8fce-919265a5e6a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:54.868968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3170ad-925d-4da3-8fce-919265a5e6a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-dd3170ad-925d-4da3-8fce-919265a5e6a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:54.874098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:54.875178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:10:54.876361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 578/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:54.881202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38651-f252-4f72-8430-b5d680d78404 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:54.959556 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:54.977738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38651-f252-4f72-8430-b5d680d78404 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:55.011345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b758843-d0fc-4630-af1a-eb9fec5cc4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:55.011969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b758843-d0fc-4630-af1a-eb9fec5cc4ed None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:55.012249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b758843-d0fc-4630-af1a-eb9fec5cc4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:55.012515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b758843-d0fc-4630-af1a-eb9fec5cc4ed None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:55.013193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b758843-d0fc-4630-af1a-eb9fec5cc4ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:55.013494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b758843-d0fc-4630-af1a-eb9fec5cc4ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:55.014841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b758843-d0fc-4630-af1a-eb9fec5cc4ed None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:55.022540 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 579/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:55.028264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3170ad-925d-4da3-8fce-919265a5e6a4 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:55.126164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3170ad-925d-4da3-8fce-919265a5e6a4 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:55.158160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae39f-6cef-4353-bbdf-03e1dccc1d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:55.161886 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae39f-6cef-4353-bbdf-03e1dccc1d50 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:55.162190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae39f-6cef-4353-bbdf-03e1dccc1d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:55.162469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae39f-6cef-4353-bbdf-03e1dccc1d50 None admin] PATH_INFO: `/v3/users/2e5337695c654d768b47c5cfd6f65117` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:55.163635 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ae39f-6cef-4353-bbdf-03e1dccc1d50 None admin] RBAC: Authorizing `identity:get_user(user_id=2e5337695c654d768b47c5cfd6f65117)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:55.165125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ae39f-6cef-4353-bbdf-03e1dccc1d50 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:55.166732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 579/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:55 2022] GET /identity/v3/users/2e5337695c654d768b47c5cfd6f65117 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:55.173825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b758843-d0fc-4630-af1a-eb9fec5cc4ed None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:55.270537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b758843-d0fc-4630-af1a-eb9fec5cc4ed None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:55.303698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ac024-548b-4e4e-9b03-0de5a0cac109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:55.304293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ac024-548b-4e4e-9b03-0de5a0cac109 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:55.304573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ac024-548b-4e4e-9b03-0de5a0cac109 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:55.304880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ac024-548b-4e4e-9b03-0de5a0cac109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:55.319201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:55.370202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ac024-548b-4e4e-9b03-0de5a0cac109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:55.371796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ac024-548b-4e4e-9b03-0de5a0cac109 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:55.466435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 580/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:55.472298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae39f-6cef-4353-bbdf-03e1dccc1d50 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:55.485140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:55.568694 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae39f-6cef-4353-bbdf-03e1dccc1d50 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:55.601782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec16c94-69c9-4063-beac-755cc8e5bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:55.602390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec16c94-69c9-4063-beac-755cc8e5bcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:55.602663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec16c94-69c9-4063-beac-755cc8e5bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:55.602927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec16c94-69c9-4063-beac-755cc8e5bcb1 None admin] PATH_INFO: `/v3/projects/11178e571e5e4b83ba390219968027d6` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:55.604000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec16c94-69c9-4063-beac-755cc8e5bcb1 None admin] RBAC: Authorizing `identity:get_project(project_id=11178e571e5e4b83ba390219968027d6)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:55.606506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec16c94-69c9-4063-beac-755cc8e5bcb1 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:55.608111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 580/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:55 2022] GET /identity/v3/projects/11178e571e5e4b83ba390219968027d6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:55.614281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ac024-548b-4e4e-9b03-0de5a0cac109 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:55.657823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:55.711110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ac024-548b-4e4e-9b03-0de5a0cac109 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:55.743904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62905e-e73f-4eba-b43d-c0298128a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:55.744491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62905e-e73f-4eba-b43d-c0298128a261 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:55.744796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62905e-e73f-4eba-b43d-c0298128a261 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:55.745065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62905e-e73f-4eba-b43d-c0298128a261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:55.745848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62905e-e73f-4eba-b43d-c0298128a261 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=11178e571e5e4b83ba390219968027d6, user.id=2e5337695c654d768b47c5cfd6f65117) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:55.746100 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62905e-e73f-4eba-b43d-c0298128a261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:55.747503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62905e-e73f-4eba-b43d-c0298128a261 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:55.753065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 581/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:55 2022] GET /identity/v3/role_assignments?user.id=2e5337695c654d768b47c5cfd6f65117&scope.project.id=11178e571e5e4b83ba390219968027d6&role.id=d6155b01aace49f887f29aa2861d31cf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:57.741159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9634b-04c1-479c-a7f5-34fb52e2e109 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:57.741657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9634b-04c1-479c-a7f5-34fb52e2e109 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:57.741657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9634b-04c1-479c-a7f5-34fb52e2e109 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:57.742981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 581/1162] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:57.748934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a43d08-274a-4bfe-a2c0-59f694f38fea None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:57.749311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a43d08-274a-4bfe-a2c0-59f694f38fea None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:57.749472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a43d08-274a-4bfe-a2c0-59f694f38fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:57.767739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e6a43d08-274a-4bfe-a2c0-59f694f38fea None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:57.768941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e6a43d08-274a-4bfe-a2c0-59f694f38fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:57.833071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 582/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:57.855101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9634b-04c1-479c-a7f5-34fb52e2e109 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:57.933424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:57.955990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9634b-04c1-479c-a7f5-34fb52e2e109 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:57.988919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c1428-172b-491f-8009-71d957646802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:57.989511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c1428-172b-491f-8009-71d957646802 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:57.989791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c1428-172b-491f-8009-71d957646802 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:57.990064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c1428-172b-491f-8009-71d957646802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:58.055861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c1428-172b-491f-8009-71d957646802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:58.057271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c1428-172b-491f-8009-71d957646802 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:58.130870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:58.152453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 582/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:58.158357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a43d08-274a-4bfe-a2c0-59f694f38fea None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:58.197824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:58.255182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a43d08-274a-4bfe-a2c0-59f694f38fea None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:58.287653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300e963-dc2d-4cdc-aaf2-3cc0d547b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:58.288265 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300e963-dc2d-4cdc-aaf2-3cc0d547b75a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:58.288541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300e963-dc2d-4cdc-aaf2-3cc0d547b75a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:58.288837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300e963-dc2d-4cdc-aaf2-3cc0d547b75a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:58.295888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300e963-dc2d-4cdc-aaf2-3cc0d547b75a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:58.297358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300e963-dc2d-4cdc-aaf2-3cc0d547b75a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-0300e963-dc2d-4cdc-aaf2-3cc0d547b75a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:58.309280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:58.310465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:10:58.311331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 583/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 9 12:10:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:58.316193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c1428-172b-491f-8009-71d957646802 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:58.411992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c1428-172b-491f-8009-71d957646802 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:58.447054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db7d75-876c-49a0-b1cc-c8dec6ac2034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:58.447632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7d75-876c-49a0-b1cc-c8dec6ac2034 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:58.447904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7d75-876c-49a0-b1cc-c8dec6ac2034 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:58.448166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7d75-876c-49a0-b1cc-c8dec6ac2034 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:58.449119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db7d75-876c-49a0-b1cc-c8dec6ac2034 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:58.449464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db7d75-876c-49a0-b1cc-c8dec6ac2034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:58.450799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db7d75-876c-49a0-b1cc-c8dec6ac2034 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:58.457564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 583/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:00.436912 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85f174-af51-425b-a6f9-c3c421363483 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:00.437368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85f174-af51-425b-a6f9-c3c421363483 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:00.437471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85f174-af51-425b-a6f9-c3c421363483 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:00.438805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 584/1167] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:00.443880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207214e-7aa6-48d1-a496-8618d07bbe5f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:00.444286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207214e-7aa6-48d1-a496-8618d07bbe5f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:00.444470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207214e-7aa6-48d1-a496-8618d07bbe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:00.462523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-8207214e-7aa6-48d1-a496-8618d07bbe5f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:00.463691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8207214e-7aa6-48d1-a496-8618d07bbe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:00.497882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:00.529028 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 584/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:00.551608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85f174-af51-425b-a6f9-c3c421363483 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:00.646333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:00.651229 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85f174-af51-425b-a6f9-c3c421363483 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:00.683942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb6c58-2e34-4191-808b-79d3df296805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:00.684467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb6c58-2e34-4191-808b-79d3df296805 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:00.684774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb6c58-2e34-4191-808b-79d3df296805 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:00.685044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb6c58-2e34-4191-808b-79d3df296805 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:00.685706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb6c58-2e34-4191-808b-79d3df296805 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:00.687067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb6c58-2e34-4191-808b-79d3df296805 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:00.703057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 585/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue Aug 9 12:11:00 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:11:02.707008 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63fd72-9611-4a8b-a8c6-a097bab6ddbe None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:02.707507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63fd72-9611-4a8b-a8c6-a097bab6ddbe None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:02.707507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63fd72-9611-4a8b-a8c6-a097bab6ddbe None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:02.708859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 585/1170] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:02.714045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b97ed-b585-4b0b-9658-6475da9e200f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:02.714523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b97ed-b585-4b0b-9658-6475da9e200f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:02.714620 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b97ed-b585-4b0b-9658-6475da9e200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:02.732683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e89b97ed-b585-4b0b-9658-6475da9e200f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:02.733857 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e89b97ed-b585-4b0b-9658-6475da9e200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:02.797527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 586/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:02.821481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63fd72-9611-4a8b-a8c6-a097bab6ddbe None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:02.919992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63fd72-9611-4a8b-a8c6-a097bab6ddbe None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:02.952093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378a56c-2b54-44d4-8077-f9928c119e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:02.952722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378a56c-2b54-44d4-8077-f9928c119e28 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:02.952999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378a56c-2b54-44d4-8077-f9928c119e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:02.953263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378a56c-2b54-44d4-8077-f9928c119e28 None admin] PATH_INFO: `/v3/domains/422bf81870cd40e4b2a260e21385d092` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:02.963149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378a56c-2b54-44d4-8077-f9928c119e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=422bf81870cd40e4b2a260e21385d092)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:02.965148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378a56c-2b54-44d4-8077-f9928c119e28 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:02.966709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 586/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Aug 9 12:11:02 2022] GET /identity/v3/domains/422bf81870cd40e4b2a260e21385d092 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:02.972458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b97ed-b585-4b0b-9658-6475da9e200f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:03.056474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:03.069145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b97ed-b585-4b0b-9658-6475da9e200f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:03.102055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ecc47-965f-4463-9647-2362ac77d8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:03.102647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ecc47-965f-4463-9647-2362ac77d8d3 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:03.102919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ecc47-965f-4463-9647-2362ac77d8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:03.103183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ecc47-965f-4463-9647-2362ac77d8d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:03.103808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ecc47-965f-4463-9647-2362ac77d8d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:03.105896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ecc47-965f-4463-9647-2362ac77d8d3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:03.130615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 587/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:11:02 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:11:05.145938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e88bf-3161-4734-b93f-7fa2c8483448 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:05.146468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e88bf-3161-4734-b93f-7fa2c8483448 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:05.146468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e88bf-3161-4734-b93f-7fa2c8483448 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:05.147822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 587/1174] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:05.152923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d46eae-f654-44d6-afe2-9d96b7ba3f51 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:05.153341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d46eae-f654-44d6-afe2-9d96b7ba3f51 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:05.153470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d46eae-f654-44d6-afe2-9d96b7ba3f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:05.171048 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f9d46eae-f654-44d6-afe2-9d96b7ba3f51 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:05.172207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f9d46eae-f654-44d6-afe2-9d96b7ba3f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:05.237238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 588/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:05.262278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e88bf-3161-4734-b93f-7fa2c8483448 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:05.293704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:05.363357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e88bf-3161-4734-b93f-7fa2c8483448 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:05.396346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f81593-5dd6-4653-b373-f377875ecdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:05.396925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f81593-5dd6-4653-b373-f377875ecdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:05.397199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f81593-5dd6-4653-b373-f377875ecdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:05.397465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f81593-5dd6-4653-b373-f377875ecdf1 None admin] PATH_INFO: `/v3/domains/422bf81870cd40e4b2a260e21385d092` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:05.398571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f81593-5dd6-4653-b373-f377875ecdf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=422bf81870cd40e4b2a260e21385d092)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:05.399998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f81593-5dd6-4653-b373-f377875ecdf1 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:05.401907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 588/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Aug 9 12:11:05 2022] GET /identity/v3/domains/422bf81870cd40e4b2a260e21385d092 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:05.407533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d46eae-f654-44d6-afe2-9d96b7ba3f51 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:05.473121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:05.504593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d46eae-f654-44d6-afe2-9d96b7ba3f51 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:05.537300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13d6cd-d25a-44be-9337-526ed6091d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:05.537876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d6cd-d25a-44be-9337-526ed6091d6e None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:05.538148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d6cd-d25a-44be-9337-526ed6091d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:05.538412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d6cd-d25a-44be-9337-526ed6091d6e None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:05.539046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13d6cd-d25a-44be-9337-526ed6091d6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:05.540444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13d6cd-d25a-44be-9337-526ed6091d6e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:05.562779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 589/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:11:05 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:11:07.574913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a08a3-87ad-4c61-b5c0-3afb2223a3db None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:07.575435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a08a3-87ad-4c61-b5c0-3afb2223a3db None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:07.575435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a08a3-87ad-4c61-b5c0-3afb2223a3db None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:07.576829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 589/1178] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:07.581983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56925112-f048-4b89-910b-fbf5b3d1cdee None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:07.582378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56925112-f048-4b89-910b-fbf5b3d1cdee None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:07.582523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56925112-f048-4b89-910b-fbf5b3d1cdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:07.600531 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-56925112-f048-4b89-910b-fbf5b3d1cdee None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:07.601726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-56925112-f048-4b89-910b-fbf5b3d1cdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:07.664732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 590/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:11:07.688471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a08a3-87ad-4c61-b5c0-3afb2223a3db None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:07.784219 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:07.788205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a08a3-87ad-4c61-b5c0-3afb2223a3db None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:07.820527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5fe2a-6a41-464a-8d93-e46dd554616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:07.821175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5fe2a-6a41-464a-8d93-e46dd554616b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:07.821450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5fe2a-6a41-464a-8d93-e46dd554616b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:07.821717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5fe2a-6a41-464a-8d93-e46dd554616b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:07.832444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5fe2a-6a41-464a-8d93-e46dd554616b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-d7f5fe2a-6a41-464a-8d93-e46dd554616b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:11:07.837007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:11:07.838069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:11:07.839617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 590/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:11:07.844574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56925112-f048-4b89-910b-fbf5b3d1cdee None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:07.898760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:07.941806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56925112-f048-4b89-910b-fbf5b3d1cdee None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:07.975290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495d5a8-9e3f-4c87-b660-d44bf2585a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:07.975879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495d5a8-9e3f-4c87-b660-d44bf2585a87 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:07.976149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495d5a8-9e3f-4c87-b660-d44bf2585a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:07.976416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495d5a8-9e3f-4c87-b660-d44bf2585a87 None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:07.977086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495d5a8-9e3f-4c87-b660-d44bf2585a87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:07.977379 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495d5a8-9e3f-4c87-b660-d44bf2585a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:07.978712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495d5a8-9e3f-4c87-b660-d44bf2585a87 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:07.987209 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 591/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:11:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:07.992975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5fe2a-6a41-464a-8d93-e46dd554616b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:08.091551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5fe2a-6a41-464a-8d93-e46dd554616b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:08.124177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644136e-7607-47bf-a729-e3eb9a076987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:08.124820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644136e-7607-47bf-a729-e3eb9a076987 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:08.125100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644136e-7607-47bf-a729-e3eb9a076987 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:08.125369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644136e-7607-47bf-a729-e3eb9a076987 None admin] PATH_INFO: `/v3/users/032e6391a220423688a2759bc8d6a757` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:08.138886 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644136e-7607-47bf-a729-e3eb9a076987 None admin] RBAC: Authorizing `identity:get_user(user_id=032e6391a220423688a2759bc8d6a757)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:08.140337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644136e-7607-47bf-a729-e3eb9a076987 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:08.141953 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 591/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:07 2022] GET /identity/v3/users/032e6391a220423688a2759bc8d6a757 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:08.147630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495d5a8-9e3f-4c87-b660-d44bf2585a87 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:08.244247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495d5a8-9e3f-4c87-b660-d44bf2585a87 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:08.260276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:08.277579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e648a-4aa7-4b1d-8271-1a0b9be9b6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:08.278185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e648a-4aa7-4b1d-8271-1a0b9be9b6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:08.278465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e648a-4aa7-4b1d-8271-1a0b9be9b6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:08.278737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e648a-4aa7-4b1d-8271-1a0b9be9b6b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:08.343642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e648a-4aa7-4b1d-8271-1a0b9be9b6b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:08.345118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e648a-4aa7-4b1d-8271-1a0b9be9b6b7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:08.439643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 592/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:11:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:11:08.445501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644136e-7607-47bf-a729-e3eb9a076987 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:08.464471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:08.544263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644136e-7607-47bf-a729-e3eb9a076987 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:08.576947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456892a-49d5-4c6e-b3b8-ae3d5dbb9d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:08.577555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456892a-49d5-4c6e-b3b8-ae3d5dbb9d72 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:08.577827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456892a-49d5-4c6e-b3b8-ae3d5dbb9d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:08.578092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456892a-49d5-4c6e-b3b8-ae3d5dbb9d72 None admin] PATH_INFO: `/v3/projects/be7ad897c3d3414cad93ec710c2d3364` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:08.579180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456892a-49d5-4c6e-b3b8-ae3d5dbb9d72 None admin] RBAC: Authorizing `identity:get_project(project_id=be7ad897c3d3414cad93ec710c2d3364)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:08.580586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456892a-49d5-4c6e-b3b8-ae3d5dbb9d72 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:08.582208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 592/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:08 2022] GET /identity/v3/projects/be7ad897c3d3414cad93ec710c2d3364 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:08.588298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e648a-4aa7-4b1d-8271-1a0b9be9b6b7 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:08.606844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:08.684484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e648a-4aa7-4b1d-8271-1a0b9be9b6b7 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:08.717587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584d19f-bce7-4693-b2bd-e926f1903c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:08.718157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d19f-bce7-4693-b2bd-e926f1903c69 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:08.718432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d19f-bce7-4693-b2bd-e926f1903c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:08.718705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d19f-bce7-4693-b2bd-e926f1903c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:08.719415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584d19f-bce7-4693-b2bd-e926f1903c69 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=be7ad897c3d3414cad93ec710c2d3364, user.id=032e6391a220423688a2759bc8d6a757) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:08.719720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584d19f-bce7-4693-b2bd-e926f1903c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:08.721165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584d19f-bce7-4693-b2bd-e926f1903c69 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:08.726335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 593/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:11:08 2022] GET /identity/v3/role_assignments?user.id=032e6391a220423688a2759bc8d6a757&scope.project.id=be7ad897c3d3414cad93ec710c2d3364&role.id=d6155b01aace49f887f29aa2861d31cf => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:11:10.684253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1fab-df2a-441e-a203-f33094b89ccf None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:10.684800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1fab-df2a-441e-a203-f33094b89ccf None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:10.684800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1fab-df2a-441e-a203-f33094b89ccf None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:10.686067 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 593/1186] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:10.691205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0734e3-cf35-46f3-b1b5-3de10f99ef41 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:10.691627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0734e3-cf35-46f3-b1b5-3de10f99ef41 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:10.691751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0734e3-cf35-46f3-b1b5-3de10f99ef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:10.710055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bd0734e3-cf35-46f3-b1b5-3de10f99ef41 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:10.711223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bd0734e3-cf35-46f3-b1b5-3de10f99ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:10.774775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 594/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:10.796952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1fab-df2a-441e-a203-f33094b89ccf None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:10.879699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:10.895744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1fab-df2a-441e-a203-f33094b89ccf None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:10.928662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b0b14-4ec6-4295-8e2c-68d5e54cab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:10.929272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b0b14-4ec6-4295-8e2c-68d5e54cab06 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:10.929548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b0b14-4ec6-4295-8e2c-68d5e54cab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:10.929813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b0b14-4ec6-4295-8e2c-68d5e54cab06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:10.939646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b0b14-4ec6-4295-8e2c-68d5e54cab06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-5c5b0b14-4ec6-4295-8e2c-68d5e54cab06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:11:10.944148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:11:10.945354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:11:10.946269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 594/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:11:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:11:10.951731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0734e3-cf35-46f3-b1b5-3de10f99ef41 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:10.966039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:11.047880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0734e3-cf35-46f3-b1b5-3de10f99ef41 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:11.080617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8cd21-715f-4aae-8926-367e86704d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:11.081302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8cd21-715f-4aae-8926-367e86704d9a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:11.081581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8cd21-715f-4aae-8926-367e86704d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:11.081848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8cd21-715f-4aae-8926-367e86704d9a None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:11.082496 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8cd21-715f-4aae-8926-367e86704d9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:11.082791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8cd21-715f-4aae-8926-367e86704d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:11.084168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8cd21-715f-4aae-8926-367e86704d9a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:11.092722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 595/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:11:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:11.098540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b0b14-4ec6-4295-8e2c-68d5e54cab06 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:11.195384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b0b14-4ec6-4295-8e2c-68d5e54cab06 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:11.228101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88c507-988e-433f-a5c7-96449e76a564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:11.228726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88c507-988e-433f-a5c7-96449e76a564 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:11.229027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88c507-988e-433f-a5c7-96449e76a564 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:11.229509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88c507-988e-433f-a5c7-96449e76a564 None admin] PATH_INFO: `/v3/users/032e6391a220423688a2759bc8d6a757` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:11.230614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88c507-988e-433f-a5c7-96449e76a564 None admin] RBAC: Authorizing `identity:get_user(user_id=032e6391a220423688a2759bc8d6a757)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:11.232035 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88c507-988e-433f-a5c7-96449e76a564 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:11.233610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 595/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:11 2022] GET /identity/v3/users/032e6391a220423688a2759bc8d6a757 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:11.239338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8cd21-715f-4aae-8926-367e86704d9a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:11.313179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:11.337479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8cd21-715f-4aae-8926-367e86704d9a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:11.369194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed5682-5c3b-4281-8674-8b94e9cd1512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:11.370409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5682-5c3b-4281-8674-8b94e9cd1512 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:11.370751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5682-5c3b-4281-8674-8b94e9cd1512 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:11.371018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5682-5c3b-4281-8674-8b94e9cd1512 None admin] PATH_INFO: `/v3/projects/be7ad897c3d3414cad93ec710c2d3364` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:11.372155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed5682-5c3b-4281-8674-8b94e9cd1512 None admin] RBAC: Authorizing `identity:get_project(project_id=be7ad897c3d3414cad93ec710c2d3364)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:11.373599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed5682-5c3b-4281-8674-8b94e9cd1512 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:11.375256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 596/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:11 2022] GET /identity/v3/projects/be7ad897c3d3414cad93ec710c2d3364 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:11.381168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88c507-988e-433f-a5c7-96449e76a564 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:11.397349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:11.479495 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88c507-988e-433f-a5c7-96449e76a564 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:11.512354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13118408-40d0-434c-be64-48b4fb797794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:11.513019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13118408-40d0-434c-be64-48b4fb797794 None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:11.513294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13118408-40d0-434c-be64-48b4fb797794 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:11.513560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13118408-40d0-434c-be64-48b4fb797794 None admin] PATH_INFO: `/v3/projects/be7ad897c3d3414cad93ec710c2d3364/users/032e6391a220423688a2759bc8d6a757/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:11.515421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13118408-40d0-434c-be64-48b4fb797794 None admin] RBAC: Authorizing `identity:create_grant(project_id=be7ad897c3d3414cad93ec710c2d3364, user_id=032e6391a220423688a2759bc8d6a757, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:11.516854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13118408-40d0-434c-be64-48b4fb797794 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:11.529270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 596/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:11:11 2022] PUT /identity/v3/projects/be7ad897c3d3414cad93ec710c2d3364/users/032e6391a220423688a2759bc8d6a757/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:11:13.482019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6032c0-9033-405d-8fbd-7c6c33a98d2e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:13.482483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6032c0-9033-405d-8fbd-7c6c33a98d2e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:13.482589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6032c0-9033-405d-8fbd-7c6c33a98d2e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:13.483904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 597/1193] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:13.489000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343147e0-7a6c-43b8-943c-81d4083102c2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:13.489434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343147e0-7a6c-43b8-943c-81d4083102c2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:13.489532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343147e0-7a6c-43b8-943c-81d4083102c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:13.507627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-343147e0-7a6c-43b8-943c-81d4083102c2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:13.508839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-343147e0-7a6c-43b8-943c-81d4083102c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:13.574161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 597/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:13.596510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6032c0-9033-405d-8fbd-7c6c33a98d2e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:13.694969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6032c0-9033-405d-8fbd-7c6c33a98d2e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:13.726773 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a130990-a039-4a5e-8f90-9bca44222194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:13.727376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a130990-a039-4a5e-8f90-9bca44222194 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:13.727700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a130990-a039-4a5e-8f90-9bca44222194 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:13.727967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a130990-a039-4a5e-8f90-9bca44222194 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:13.739033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a130990-a039-4a5e-8f90-9bca44222194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-1a130990-a039-4a5e-8f90-9bca44222194 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:11:13.743573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:11:13.745200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:11:13.746494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 598/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:11:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:11:13.751104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343147e0-7a6c-43b8-943c-81d4083102c2 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:13.754111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:13.847354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343147e0-7a6c-43b8-943c-81d4083102c2 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:13.880959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776986-c4ab-42ea-b057-5a393c8576fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:13.881553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776986-c4ab-42ea-b057-5a393c8576fb None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:13.881832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776986-c4ab-42ea-b057-5a393c8576fb None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:13.882103 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776986-c4ab-42ea-b057-5a393c8576fb None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:13.882755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776986-c4ab-42ea-b057-5a393c8576fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:13.883057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776986-c4ab-42ea-b057-5a393c8576fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:13.884419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776986-c4ab-42ea-b057-5a393c8576fb None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:13.892249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 598/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:11:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:13.897864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a130990-a039-4a5e-8f90-9bca44222194 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:13.900687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:13.995877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a130990-a039-4a5e-8f90-9bca44222194 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:14.027950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c4022-003f-4a67-b903-9c437156bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:14.028561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4022-003f-4a67-b903-9c437156bff6 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:14.028865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4022-003f-4a67-b903-9c437156bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:14.029241 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4022-003f-4a67-b903-9c437156bff6 None admin] PATH_INFO: `/v3/users/032e6391a220423688a2759bc8d6a757` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:14.030435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c4022-003f-4a67-b903-9c437156bff6 None admin] RBAC: Authorizing `identity:get_user(user_id=032e6391a220423688a2759bc8d6a757)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:14.031874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c4022-003f-4a67-b903-9c437156bff6 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:14.033499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 599/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:13 2022] GET /identity/v3/users/032e6391a220423688a2759bc8d6a757 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:14.039320 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776986-c4ab-42ea-b057-5a393c8576fb None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:14.104970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:14.139308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776986-c4ab-42ea-b057-5a393c8576fb None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:14.172454 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df6107-ed81-48b2-9750-d75a0550f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:14.173077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df6107-ed81-48b2-9750-d75a0550f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:14.173634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df6107-ed81-48b2-9750-d75a0550f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:14.173898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df6107-ed81-48b2-9750-d75a0550f6f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:14.238372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df6107-ed81-48b2-9750-d75a0550f6f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:14.239811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df6107-ed81-48b2-9750-d75a0550f6f5 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:14.300574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:14.334492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 599/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:11:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:11:14.341148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c4022-003f-4a67-b903-9c437156bff6 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:14.408130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:14.440947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c4022-003f-4a67-b903-9c437156bff6 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:14.473852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26298a2f-f77f-4cba-9cee-2950492939b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:14.474460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26298a2f-f77f-4cba-9cee-2950492939b3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:14.474732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26298a2f-f77f-4cba-9cee-2950492939b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:14.475004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26298a2f-f77f-4cba-9cee-2950492939b3 None admin] PATH_INFO: `/v3/projects/be7ad897c3d3414cad93ec710c2d3364` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:14.476083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26298a2f-f77f-4cba-9cee-2950492939b3 None admin] RBAC: Authorizing `identity:get_project(project_id=be7ad897c3d3414cad93ec710c2d3364)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:14.477513 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26298a2f-f77f-4cba-9cee-2950492939b3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:14.479813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 600/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:14 2022] GET /identity/v3/projects/be7ad897c3d3414cad93ec710c2d3364 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:14.485863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df6107-ed81-48b2-9750-d75a0550f6f5 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:14.581559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df6107-ed81-48b2-9750-d75a0550f6f5 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:14.614504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae670c91-3e15-4018-a840-46410e5f5d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:14.615095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae670c91-3e15-4018-a840-46410e5f5d2c None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:14.615395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae670c91-3e15-4018-a840-46410e5f5d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:14.615662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae670c91-3e15-4018-a840-46410e5f5d2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:14.616372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae670c91-3e15-4018-a840-46410e5f5d2c None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=be7ad897c3d3414cad93ec710c2d3364, user.id=032e6391a220423688a2759bc8d6a757) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:14.616701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae670c91-3e15-4018-a840-46410e5f5d2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:14.618128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae670c91-3e15-4018-a840-46410e5f5d2c None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:14.624147 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 600/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:11:14 2022] GET /identity/v3/role_assignments?user.id=032e6391a220423688a2759bc8d6a757&scope.project.id=be7ad897c3d3414cad93ec710c2d3364&role.id=d6155b01aace49f887f29aa2861d31cf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:24.469822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=31 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:24.621603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=85 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:09.442774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39938-052a-4b7f-b89c-503a973489d6 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:09.442774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39938-052a-4b7f-b89c-503a973489d6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:09.442774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39938-052a-4b7f-b89c-503a973489d6 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:09.442774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 601/1201] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:09.449056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06da65-a08d-4576-98d8-a97abbba207d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:09.449509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06da65-a08d-4576-98d8-a97abbba207d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:09.452253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06da65-a08d-4576-98d8-a97abbba207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:09.470563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4c06da65-a08d-4576-98d8-a97abbba207d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:09.471804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4c06da65-a08d-4576-98d8-a97abbba207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:09.565274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 601/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:09.594165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc39938-052a-4b7f-b89c-503a973489d6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:09.733393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc39938-052a-4b7f-b89c-503a973489d6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:09.772742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef824446-a084-4ed6-b12a-813d0080eb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:09.774238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef824446-a084-4ed6-b12a-813d0080eb20 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:09.774596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef824446-a084-4ed6-b12a-813d0080eb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:09.774918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef824446-a084-4ed6-b12a-813d0080eb20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:09.796279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef824446-a084-4ed6-b12a-813d0080eb20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:09.798362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef824446-a084-4ed6-b12a-813d0080eb20 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-ef824446-a084-4ed6-b12a-813d0080eb20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:09.815060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:09.816149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:09.820587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:09.820587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:09.820587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:09.820587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 602/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:09.824122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06da65-a08d-4576-98d8-a97abbba207d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:09.968668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06da65-a08d-4576-98d8-a97abbba207d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:10.016361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:10.025317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f90ddb-5021-409e-b6a2-f229423f4fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:10.026577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f90ddb-5021-409e-b6a2-f229423f4fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:10.027267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f90ddb-5021-409e-b6a2-f229423f4fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:10.027741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f90ddb-5021-409e-b6a2-f229423f4fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:10.028647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f90ddb-5021-409e-b6a2-f229423f4fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:10.035952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f90ddb-5021-409e-b6a2-f229423f4fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:10.035952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f90ddb-5021-409e-b6a2-f229423f4fc3 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:10.049870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 602/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:10.056729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef824446-a084-4ed6-b12a-813d0080eb20 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:10.133645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:10.197193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef824446-a084-4ed6-b12a-813d0080eb20 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:10.240793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c09241-66e8-4bb5-88dc-8482197dcff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:10.240793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09241-66e8-4bb5-88dc-8482197dcff8 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:10.240793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09241-66e8-4bb5-88dc-8482197dcff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:10.240793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09241-66e8-4bb5-88dc-8482197dcff8 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:10.241244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c09241-66e8-4bb5-88dc-8482197dcff8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:10.243414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c09241-66e8-4bb5-88dc-8482197dcff8 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:10.280808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 603/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Aug 9 12:12:10 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:12:12.566051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838692e4-c6d4-4e6d-b635-e22dcf781302 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:12.566669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838692e4-c6d4-4e6d-b635-e22dcf781302 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:12.566669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838692e4-c6d4-4e6d-b635-e22dcf781302 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:12.567950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 603/1206] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:12.574096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f1c89-4e03-4fe3-8834-b3ce8731c4d3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:12.574562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f1c89-4e03-4fe3-8834-b3ce8731c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:12.574642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f1c89-4e03-4fe3-8834-b3ce8731c4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:12.593552 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-045f1c89-4e03-4fe3-8834-b3ce8731c4d3 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:12.594748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-045f1c89-4e03-4fe3-8834-b3ce8731c4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:12.670233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 604/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:12.695561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838692e4-c6d4-4e6d-b635-e22dcf781302 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:12.821337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838692e4-c6d4-4e6d-b635-e22dcf781302 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:12.857992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91747ae-78e7-4177-a486-4ae3d0f026d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:12.858678 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91747ae-78e7-4177-a486-4ae3d0f026d9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:12.859050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91747ae-78e7-4177-a486-4ae3d0f026d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:12.859277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91747ae-78e7-4177-a486-4ae3d0f026d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:12.872078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91747ae-78e7-4177-a486-4ae3d0f026d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-b91747ae-78e7-4177-a486-4ae3d0f026d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:12.876827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:12.877906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:12.878836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 604/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:12.889575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f1c89-4e03-4fe3-8834-b3ce8731c4d3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:12.940813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:13.009550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f1c89-4e03-4fe3-8834-b3ce8731c4d3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:13.050589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfdaab-4e6f-4207-a26c-17a12d3b4bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:13.051203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfdaab-4e6f-4207-a26c-17a12d3b4bfc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:13.051485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfdaab-4e6f-4207-a26c-17a12d3b4bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:13.051824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfdaab-4e6f-4207-a26c-17a12d3b4bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:13.052564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfdaab-4e6f-4207-a26c-17a12d3b4bfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:13.053743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfdaab-4e6f-4207-a26c-17a12d3b4bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:13.055274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfdaab-4e6f-4207-a26c-17a12d3b4bfc None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:13.069844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 605/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:13.073710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91747ae-78e7-4177-a486-4ae3d0f026d9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:13.134642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:13.198618 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91747ae-78e7-4177-a486-4ae3d0f026d9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:13.238518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1c048-5902-4407-95c5-ed5f72683b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:13.239441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c048-5902-4407-95c5-ed5f72683b1d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:13.239944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c048-5902-4407-95c5-ed5f72683b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:13.240437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c048-5902-4407-95c5-ed5f72683b1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:13.253647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1c048-5902-4407-95c5-ed5f72683b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:13.255884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1c048-5902-4407-95c5-ed5f72683b1d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-f4f1c048-5902-4407-95c5-ed5f72683b1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:13.272652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:13.274269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:13.275187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:13.275187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:13.275187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:13.275187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 605/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:13.280848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfdaab-4e6f-4207-a26c-17a12d3b4bfc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:13.403890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:13.407234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfdaab-4e6f-4207-a26c-17a12d3b4bfc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:13.453221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ce6b6-dea8-4d22-a4fc-c2a3dd8c6343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:13.453760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ce6b6-dea8-4d22-a4fc-c2a3dd8c6343 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:13.454026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ce6b6-dea8-4d22-a4fc-c2a3dd8c6343 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:13.454291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ce6b6-dea8-4d22-a4fc-c2a3dd8c6343 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:13.454961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ce6b6-dea8-4d22-a4fc-c2a3dd8c6343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:13.455281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ce6b6-dea8-4d22-a4fc-c2a3dd8c6343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:13.456915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ce6b6-dea8-4d22-a4fc-c2a3dd8c6343 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:13.475024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 606/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:13.478646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1c048-5902-4407-95c5-ed5f72683b1d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:13.607274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1c048-5902-4407-95c5-ed5f72683b1d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:13.608994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:13.645349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3517756-b9a0-49f0-9473-09ff4626ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:13.645980 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3517756-b9a0-49f0-9473-09ff4626ee06 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:13.649533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3517756-b9a0-49f0-9473-09ff4626ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:13.649533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3517756-b9a0-49f0-9473-09ff4626ee06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:13.655486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3517756-b9a0-49f0-9473-09ff4626ee06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:13.657113 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3517756-b9a0-49f0-9473-09ff4626ee06 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-f3517756-b9a0-49f0-9473-09ff4626ee06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:13.669828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:13.671066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:13.672032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 606/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:13.677376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ce6b6-dea8-4d22-a4fc-c2a3dd8c6343 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:13.793094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ce6b6-dea8-4d22-a4fc-c2a3dd8c6343 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:13.832081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fb476-7102-459a-a1c6-dd95a1dce14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:13.832940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb476-7102-459a-a1c6-dd95a1dce14c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:13.833228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb476-7102-459a-a1c6-dd95a1dce14c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:13.833502 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb476-7102-459a-a1c6-dd95a1dce14c None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:13.834329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fb476-7102-459a-a1c6-dd95a1dce14c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:13.834637 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fb476-7102-459a-a1c6-dd95a1dce14c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:13.836814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fb476-7102-459a-a1c6-dd95a1dce14c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:13.855702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 607/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:13.862102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3517756-b9a0-49f0-9473-09ff4626ee06 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:13.983319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3517756-b9a0-49f0-9473-09ff4626ee06 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:14.021894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56174c-76d7-4cca-a506-9d2b37e17226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:14.023626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56174c-76d7-4cca-a506-9d2b37e17226 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:14.023626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56174c-76d7-4cca-a506-9d2b37e17226 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:14.024110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56174c-76d7-4cca-a506-9d2b37e17226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:14.060275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:14.104606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56174c-76d7-4cca-a506-9d2b37e17226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:14.106598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56174c-76d7-4cca-a506-9d2b37e17226 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:14.227419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 607/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:12:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:12:14.233743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fb476-7102-459a-a1c6-dd95a1dce14c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:14.255115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:14.358260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fb476-7102-459a-a1c6-dd95a1dce14c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:14.400977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8392e-a431-4563-81e0-023b9958d32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:14.401958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8392e-a431-4563-81e0-023b9958d32b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:14.402302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8392e-a431-4563-81e0-023b9958d32b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:14.402574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8392e-a431-4563-81e0-023b9958d32b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:14.416801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8392e-a431-4563-81e0-023b9958d32b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:14.419069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8392e-a431-4563-81e0-023b9958d32b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-bff8392e-a431-4563-81e0-023b9958d32b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:14.440177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:14.441543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:14.442524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:14.442524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:14.442524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:14.442524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 608/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:14.447688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56174c-76d7-4cca-a506-9d2b37e17226 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:14.517927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:14.565213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56174c-76d7-4cca-a506-9d2b37e17226 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:14.607621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0892-99f7-485c-a937-ddd3fa386430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:14.608364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0892-99f7-485c-a937-ddd3fa386430 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:14.608477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0892-99f7-485c-a937-ddd3fa386430 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:14.608768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0892-99f7-485c-a937-ddd3fa386430 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:14.609401 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d0892-99f7-485c-a937-ddd3fa386430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:14.609712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d0892-99f7-485c-a937-ddd3fa386430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:14.611120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d0892-99f7-485c-a937-ddd3fa386430 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:14.623460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 608/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:14.629114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8392e-a431-4563-81e0-023b9958d32b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:14.706960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:14.746885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8392e-a431-4563-81e0-023b9958d32b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:14.789372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0932f79-8e6e-485c-998f-f50d3ae0272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:14.790166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932f79-8e6e-485c-998f-f50d3ae0272f None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:14.790477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932f79-8e6e-485c-998f-f50d3ae0272f None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:14.790765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932f79-8e6e-485c-998f-f50d3ae0272f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:14.802451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932f79-8e6e-485c-998f-f50d3ae0272f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:14.804657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932f79-8e6e-485c-998f-f50d3ae0272f None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e0932f79-8e6e-485c-998f-f50d3ae0272f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:14.817782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:14.818845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:14.820323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:14.820323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:14.820323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:14.820323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:14.820323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:14.820323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:14.820323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:14.820323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:14.820323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 609/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:14.825771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0892-99f7-485c-a937-ddd3fa386430 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:14.948408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0892-99f7-485c-a937-ddd3fa386430 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:14.974522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:14.988122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d706f76-72d3-49fd-99a5-71a3980b9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:14.988990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706f76-72d3-49fd-99a5-71a3980b9404 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:14.989426 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706f76-72d3-49fd-99a5-71a3980b9404 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:14.989872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706f76-72d3-49fd-99a5-71a3980b9404 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:14.990709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d706f76-72d3-49fd-99a5-71a3980b9404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:14.991165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d706f76-72d3-49fd-99a5-71a3980b9404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:14.993293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d706f76-72d3-49fd-99a5-71a3980b9404 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:15.005438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 609/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:15.012176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0932f79-8e6e-485c-998f-f50d3ae0272f None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:15.125591 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0932f79-8e6e-485c-998f-f50d3ae0272f None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:15.155241 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:15.161117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e295c-14c5-465e-9e72-4daa70b56aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:15.161717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e295c-14c5-465e-9e72-4daa70b56aac None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:15.161982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e295c-14c5-465e-9e72-4daa70b56aac None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:15.162279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e295c-14c5-465e-9e72-4daa70b56aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:15.162959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e295c-14c5-465e-9e72-4daa70b56aac None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=c7f2e22ace8648919104c910c74c1711) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:15.163335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e295c-14c5-465e-9e72-4daa70b56aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:15.165122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e295c-14c5-465e-9e72-4daa70b56aac None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:15.170659 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 610/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:12:15 2022] GET /identity/v3/role_assignments?user.id=c7f2e22ace8648919104c910c74c1711&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:17.245710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5a802-c56e-40ea-a959-4ab23befe145 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:17.246267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5a802-c56e-40ea-a959-4ab23befe145 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:17.246267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5a802-c56e-40ea-a959-4ab23befe145 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:17.247629 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 610/1220] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:17.252918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeedcdd-c9c5-493e-aead-d008a9b41983 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:17.253346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeedcdd-c9c5-493e-aead-d008a9b41983 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:17.253465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeedcdd-c9c5-493e-aead-d008a9b41983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:17.273820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ffeedcdd-c9c5-493e-aead-d008a9b41983 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:17.275424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ffeedcdd-c9c5-493e-aead-d008a9b41983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:17.351254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 611/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:12:17.376296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5a802-c56e-40ea-a959-4ab23befe145 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:17.499510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5a802-c56e-40ea-a959-4ab23befe145 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:17.535133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8b189-bba8-49af-86d3-6c7bbebdc5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:17.535898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8b189-bba8-49af-86d3-6c7bbebdc5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:17.536255 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8b189-bba8-49af-86d3-6c7bbebdc5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:17.536538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8b189-bba8-49af-86d3-6c7bbebdc5f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:17.550027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8b189-bba8-49af-86d3-6c7bbebdc5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-b2b8b189-bba8-49af-86d3-6c7bbebdc5f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:17.555305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:17.556456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:17.557553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 611/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:12:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:17.563192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeedcdd-c9c5-493e-aead-d008a9b41983 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:17.661287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeedcdd-c9c5-493e-aead-d008a9b41983 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:17.685488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:17.696451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401dc69-2137-4fb9-a3ac-5c82cef2871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:17.697087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401dc69-2137-4fb9-a3ac-5c82cef2871c None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:17.697367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401dc69-2137-4fb9-a3ac-5c82cef2871c None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:17.697641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401dc69-2137-4fb9-a3ac-5c82cef2871c None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:17.698492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401dc69-2137-4fb9-a3ac-5c82cef2871c None admin] RBAC: Adding query filter params (name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:17.698855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401dc69-2137-4fb9-a3ac-5c82cef2871c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:17.700664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401dc69-2137-4fb9-a3ac-5c82cef2871c None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:17.714490 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 612/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:12:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:17.715957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8b189-bba8-49af-86d3-6c7bbebdc5f0 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:17.767456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:17.829830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8b189-bba8-49af-86d3-6c7bbebdc5f0 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:17.867963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e10f50-aa8b-4ab2-95e4-4e01afa5f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:17.868580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10f50-aa8b-4ab2-95e4-4e01afa5f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:17.868909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10f50-aa8b-4ab2-95e4-4e01afa5f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:17.869173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10f50-aa8b-4ab2-95e4-4e01afa5f6a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:17.879073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e10f50-aa8b-4ab2-95e4-4e01afa5f6a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:17.880561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e10f50-aa8b-4ab2-95e4-4e01afa5f6a9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-d2e10f50-aa8b-4ab2-95e4-4e01afa5f6a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:17.894944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:17.895943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:17.897262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:17.897262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:17.897262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:17.897262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 612/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:17.903072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401dc69-2137-4fb9-a3ac-5c82cef2871c None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:18.011434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401dc69-2137-4fb9-a3ac-5c82cef2871c None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:18.048024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd844863-9943-4483-a911-f00411d063f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:18.048550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd844863-9943-4483-a911-f00411d063f9 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:18.048852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd844863-9943-4483-a911-f00411d063f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:18.049114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd844863-9943-4483-a911-f00411d063f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:18.049744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd844863-9943-4483-a911-f00411d063f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:18.050037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd844863-9943-4483-a911-f00411d063f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:18.051456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd844863-9943-4483-a911-f00411d063f9 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:18.067411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 613/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:18.073584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e10f50-aa8b-4ab2-95e4-4e01afa5f6a9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:18.181950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:18.189680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e10f50-aa8b-4ab2-95e4-4e01afa5f6a9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:18.227593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab58c7-ab13-448c-8c42-320be852bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:18.228235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab58c7-ab13-448c-8c42-320be852bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:18.228548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab58c7-ab13-448c-8c42-320be852bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:18.228844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab58c7-ab13-448c-8c42-320be852bfc9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:18.236418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab58c7-ab13-448c-8c42-320be852bfc9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:18.237946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab58c7-ab13-448c-8c42-320be852bfc9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-79ab58c7-ab13-448c-8c42-320be852bfc9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:18.248930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:18.250356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:18.251321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 613/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:18.256251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd844863-9943-4483-a911-f00411d063f9 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:18.309671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:18.363270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd844863-9943-4483-a911-f00411d063f9 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:18.400662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b12d1-c65b-40b1-a1b6-f7616f8b1c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:18.401652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b12d1-c65b-40b1-a1b6-f7616f8b1c75 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:18.402109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b12d1-c65b-40b1-a1b6-f7616f8b1c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:18.402554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b12d1-c65b-40b1-a1b6-f7616f8b1c75 None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:18.403839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b12d1-c65b-40b1-a1b6-f7616f8b1c75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:18.404354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b12d1-c65b-40b1-a1b6-f7616f8b1c75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:18.406875 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b12d1-c65b-40b1-a1b6-f7616f8b1c75 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:18.433385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 614/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:18.434675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab58c7-ab13-448c-8c42-320be852bfc9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:18.547237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab58c7-ab13-448c-8c42-320be852bfc9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:18.583750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4aa82-733f-4e28-bddd-e6eb252d1a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:18.584300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4aa82-733f-4e28-bddd-e6eb252d1a33 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:18.584579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4aa82-733f-4e28-bddd-e6eb252d1a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:18.584905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4aa82-733f-4e28-bddd-e6eb252d1a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:18.596793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4aa82-733f-4e28-bddd-e6eb252d1a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:18.598233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4aa82-733f-4e28-bddd-e6eb252d1a33 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-7eb4aa82-733f-4e28-bddd-e6eb252d1a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:18.613297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:18.614383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:18.615324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:18.615324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:18.615324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:18.619901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 614/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:18.621027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b12d1-c65b-40b1-a1b6-f7616f8b1c75 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:18.733429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b12d1-c65b-40b1-a1b6-f7616f8b1c75 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:18.736017 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:18.773979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6db792-697e-49b6-bf90-9433d91cabdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:18.774630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db792-697e-49b6-bf90-9433d91cabdb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:18.774909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db792-697e-49b6-bf90-9433d91cabdb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:18.775178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db792-697e-49b6-bf90-9433d91cabdb None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:18.775929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6db792-697e-49b6-bf90-9433d91cabdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:18.776228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6db792-697e-49b6-bf90-9433d91cabdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:18.777865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6db792-697e-49b6-bf90-9433d91cabdb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:18.789915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 615/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:18.796160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4aa82-733f-4e28-bddd-e6eb252d1a33 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:18.806988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:18.911923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4aa82-733f-4e28-bddd-e6eb252d1a33 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:18.949527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd3a1d-babe-4536-81ac-606236aff309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:18.950145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd3a1d-babe-4536-81ac-606236aff309 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:18.950418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd3a1d-babe-4536-81ac-606236aff309 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:18.950683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd3a1d-babe-4536-81ac-606236aff309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:18.957315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd3a1d-babe-4536-81ac-606236aff309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:18.959128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd3a1d-babe-4536-81ac-606236aff309 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-b6dd3a1d-babe-4536-81ac-606236aff309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:18.971196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:18.972342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:18.973262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:18.973262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:18.973262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:18.973262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:18.973262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:18.973262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:18.973262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:18.973262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:18.973262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 615/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:18.979145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6db792-697e-49b6-bf90-9433d91cabdb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:19.087435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6db792-697e-49b6-bf90-9433d91cabdb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:19.128061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997145c-3bf8-4f51-8196-1b53fe136e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:19.128636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997145c-3bf8-4f51-8196-1b53fe136e06 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:19.128926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997145c-3bf8-4f51-8196-1b53fe136e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:19.129189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997145c-3bf8-4f51-8196-1b53fe136e06 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:19.129889 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997145c-3bf8-4f51-8196-1b53fe136e06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:19.130178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997145c-3bf8-4f51-8196-1b53fe136e06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:19.131639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997145c-3bf8-4f51-8196-1b53fe136e06 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:19.144364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 616/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:19.151029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd3a1d-babe-4536-81ac-606236aff309 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:19.224692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:19.262283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd3a1d-babe-4536-81ac-606236aff309 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:19.296470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78de432-1c34-4145-a27c-a28391557e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:19.297131 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78de432-1c34-4145-a27c-a28391557e4a None admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:19.297728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78de432-1c34-4145-a27c-a28391557e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:19.298007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78de432-1c34-4145-a27c-a28391557e4a None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/c7f2e22ace8648919104c910c74c1711/roles/5efe6ea0b4354fd3821aaac43d4595d8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:19.313711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78de432-1c34-4145-a27c-a28391557e4a None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=c7f2e22ace8648919104c910c74c1711, role_id=5efe6ea0b4354fd3821aaac43d4595d8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:19.315183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78de432-1c34-4145-a27c-a28391557e4a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:19.328574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 616/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:12:19 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/c7f2e22ace8648919104c910c74c1711/roles/5efe6ea0b4354fd3821aaac43d4595d8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:12:21.549625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66593-3183-4547-bd22-8d43efeb2c6a None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:21.550171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66593-3183-4547-bd22-8d43efeb2c6a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:21.550171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66593-3183-4547-bd22-8d43efeb2c6a None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:21.551492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 617/1233] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:21.557173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0eca3-e230-4788-ada4-cd7bf4f8f52f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:21.557653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0eca3-e230-4788-ada4-cd7bf4f8f52f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:21.557753 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0eca3-e230-4788-ada4-cd7bf4f8f52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:21.575800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4bb0eca3-e230-4788-ada4-cd7bf4f8f52f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:21.577246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4bb0eca3-e230-4788-ada4-cd7bf4f8f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:21.651090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 617/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:21.674764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e66593-3183-4547-bd22-8d43efeb2c6a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:21.702335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:21.787322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e66593-3183-4547-bd22-8d43efeb2c6a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:21.823516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a36650-e0bc-40b7-a377-3411eaf819dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:21.824163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36650-e0bc-40b7-a377-3411eaf819dc None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:21.824435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36650-e0bc-40b7-a377-3411eaf819dc None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:21.824728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36650-e0bc-40b7-a377-3411eaf819dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:21.834605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a36650-e0bc-40b7-a377-3411eaf819dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e1a36650-e0bc-40b7-a377-3411eaf819dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:21.839564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:21.840663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:21.841754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 618/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Aug 9 12:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:21.848877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0eca3-e230-4788-ada4-cd7bf4f8f52f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:21.895538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:21.953831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0eca3-e230-4788-ada4-cd7bf4f8f52f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:21.989001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a605b55-eef5-49c4-9cef-3a5c1f3dd357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:21.989619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a605b55-eef5-49c4-9cef-3a5c1f3dd357 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:21.989890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a605b55-eef5-49c4-9cef-3a5c1f3dd357 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:21.990163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a605b55-eef5-49c4-9cef-3a5c1f3dd357 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:21.990817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a605b55-eef5-49c4-9cef-3a5c1f3dd357 None admin] RBAC: Adding query filter params (name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:21.991149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a605b55-eef5-49c4-9cef-3a5c1f3dd357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:21.992706 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a605b55-eef5-49c4-9cef-3a5c1f3dd357 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:22.006103 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 618/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Aug 9 12:12:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:22.007789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a36650-e0bc-40b7-a377-3411eaf819dc None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:22.100893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:22.119913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a36650-e0bc-40b7-a377-3411eaf819dc None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:22.162145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa5814-62c4-4040-8ad8-42e9e161357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:22.162765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa5814-62c4-4040-8ad8-42e9e161357a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:22.163185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa5814-62c4-4040-8ad8-42e9e161357a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:22.163452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa5814-62c4-4040-8ad8-42e9e161357a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:22.174369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa5814-62c4-4040-8ad8-42e9e161357a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:22.175850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa5814-62c4-4040-8ad8-42e9e161357a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f9aa5814-62c4-4040-8ad8-42e9e161357a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:22.192179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:22.193426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:22.194891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:22.194891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:22.194891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:22.194891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 619/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:22.200169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a605b55-eef5-49c4-9cef-3a5c1f3dd357 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:22.318624 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a605b55-eef5-49c4-9cef-3a5c1f3dd357 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:22.329874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:22.356942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d468-7a3a-4d0e-a157-e3bfa663ea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:22.357544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d468-7a3a-4d0e-a157-e3bfa663ea0b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:22.357817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d468-7a3a-4d0e-a157-e3bfa663ea0b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:22.358082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d468-7a3a-4d0e-a157-e3bfa663ea0b None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:22.358766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d468-7a3a-4d0e-a157-e3bfa663ea0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:22.359110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d468-7a3a-4d0e-a157-e3bfa663ea0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:22.360522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d468-7a3a-4d0e-a157-e3bfa663ea0b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:22.373156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 619/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:22.379316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa5814-62c4-4040-8ad8-42e9e161357a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:22.490147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa5814-62c4-4040-8ad8-42e9e161357a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:22.524992 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef6c06-dcb9-4f7f-9da8-3e8944458898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:22.525780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef6c06-dcb9-4f7f-9da8-3e8944458898 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:22.526102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef6c06-dcb9-4f7f-9da8-3e8944458898 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:22.526398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef6c06-dcb9-4f7f-9da8-3e8944458898 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:22.529281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:22.535292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef6c06-dcb9-4f7f-9da8-3e8944458898 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:22.537205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef6c06-dcb9-4f7f-9da8-3e8944458898 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-d7ef6c06-dcb9-4f7f-9da8-3e8944458898 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:22.549883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:22.551515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:22.552831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 620/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:22.557307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d468-7a3a-4d0e-a157-e3bfa663ea0b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:22.665154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d468-7a3a-4d0e-a157-e3bfa663ea0b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:22.702668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b1553-8d17-43bd-9876-0643aa79713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:22.703278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b1553-8d17-43bd-9876-0643aa79713b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:22.703557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b1553-8d17-43bd-9876-0643aa79713b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:22.703828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b1553-8d17-43bd-9876-0643aa79713b None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:22.704555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b1553-8d17-43bd-9876-0643aa79713b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:22.704891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b1553-8d17-43bd-9876-0643aa79713b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:22.706325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b1553-8d17-43bd-9876-0643aa79713b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:22.731245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 620/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:22.732497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef6c06-dcb9-4f7f-9da8-3e8944458898 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:22.845275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef6c06-dcb9-4f7f-9da8-3e8944458898 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:22.882943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a57c9-4e28-4710-b945-1977ef937913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:22.883699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a57c9-4e28-4710-b945-1977ef937913 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:22.884071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a57c9-4e28-4710-b945-1977ef937913 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:22.884437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a57c9-4e28-4710-b945-1977ef937913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:22.949233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:22.956977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a57c9-4e28-4710-b945-1977ef937913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:22.958411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a57c9-4e28-4710-b945-1977ef937913 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:23.062705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 621/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:12:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:12:23.068638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b1553-8d17-43bd-9876-0643aa79713b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:23.099677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:23.182507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b1553-8d17-43bd-9876-0643aa79713b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:23.223863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052690e-60f7-46aa-98e5-7d0f56f95538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:23.224470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052690e-60f7-46aa-98e5-7d0f56f95538 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:23.224814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052690e-60f7-46aa-98e5-7d0f56f95538 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:23.225211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052690e-60f7-46aa-98e5-7d0f56f95538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:23.236596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052690e-60f7-46aa-98e5-7d0f56f95538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:23.238276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052690e-60f7-46aa-98e5-7d0f56f95538 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-c052690e-60f7-46aa-98e5-7d0f56f95538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:23.254579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:23.255775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:23.261803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:23.261803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:23.261803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:23.261803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 621/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:23.263390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a57c9-4e28-4710-b945-1977ef937913 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:23.364290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:23.371030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a57c9-4e28-4710-b945-1977ef937913 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:23.418701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82083273-0fb0-4716-a304-b733cb998203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:23.419444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083273-0fb0-4716-a304-b733cb998203 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:23.419706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083273-0fb0-4716-a304-b733cb998203 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:23.420002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083273-0fb0-4716-a304-b733cb998203 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:23.420803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82083273-0fb0-4716-a304-b733cb998203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:23.421299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82083273-0fb0-4716-a304-b733cb998203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:23.423266 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82083273-0fb0-4716-a304-b733cb998203 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:23.437191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 622/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:23.443134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052690e-60f7-46aa-98e5-7d0f56f95538 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:23.529709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:23.554525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052690e-60f7-46aa-98e5-7d0f56f95538 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:23.597189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5ab78-e0f1-436f-88c0-b3da1bc5c2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:23.598148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ab78-e0f1-436f-88c0-b3da1bc5c2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:23.598670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ab78-e0f1-436f-88c0-b3da1bc5c2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:23.598967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5ab78-e0f1-436f-88c0-b3da1bc5c2c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:23.606861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5ab78-e0f1-436f-88c0-b3da1bc5c2c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:23.608307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5ab78-e0f1-436f-88c0-b3da1bc5c2c9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-aee5ab78-e0f1-436f-88c0-b3da1bc5c2c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:23.620257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:23.621425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:23.622526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:23.622526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:23.622526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:23.622526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:23.622526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:23.622526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:23.622526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:23.622526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:23.622526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 622/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:23.627483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82083273-0fb0-4716-a304-b733cb998203 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:23.739936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82083273-0fb0-4716-a304-b733cb998203 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:23.778603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73f224-3307-468b-8692-85cd3e2ca03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:23.779252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73f224-3307-468b-8692-85cd3e2ca03b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:23.779532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73f224-3307-468b-8692-85cd3e2ca03b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:23.779850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73f224-3307-468b-8692-85cd3e2ca03b None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:23.780556 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73f224-3307-468b-8692-85cd3e2ca03b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:23.780895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73f224-3307-468b-8692-85cd3e2ca03b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:23.782476 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73f224-3307-468b-8692-85cd3e2ca03b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:23.796736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 623/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:23.803287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5ab78-e0f1-436f-88c0-b3da1bc5c2c9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:23.911400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5ab78-e0f1-436f-88c0-b3da1bc5c2c9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:23.949954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a4e34-f529-4e16-9778-65dd67973f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:23.950637 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4e34-f529-4e16-9778-65dd67973f98 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:23.950987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4e34-f529-4e16-9778-65dd67973f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:23.951229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4e34-f529-4e16-9778-65dd67973f98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:23.952037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a4e34-f529-4e16-9778-65dd67973f98 None admin] RBAC: Adding query filter params (role.id=5efe6ea0b4354fd3821aaac43d4595d8, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=c7f2e22ace8648919104c910c74c1711) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:23.952356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a4e34-f529-4e16-9778-65dd67973f98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:23.953955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a4e34-f529-4e16-9778-65dd67973f98 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:23.961236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 623/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:12:23 2022] GET /identity/v3/role_assignments?user.id=c7f2e22ace8648919104c910c74c1711&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=5efe6ea0b4354fd3821aaac43d4595d8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:26.157979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f843a22-8848-4407-b66f-21f735020679 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:26.158683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f843a22-8848-4407-b66f-21f735020679 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:26.158683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f843a22-8848-4407-b66f-21f735020679 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:26.159845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 624/1247] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:26.165969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50340686-acee-4968-99af-d6b91828cd28 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:26.166497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50340686-acee-4968-99af-d6b91828cd28 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:26.166497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50340686-acee-4968-99af-d6b91828cd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:26.173142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:26.185972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-50340686-acee-4968-99af-d6b91828cd28 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:26.187154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-50340686-acee-4968-99af-d6b91828cd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:26.262375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 624/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:26.286117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f843a22-8848-4407-b66f-21f735020679 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:26.307267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:26.403473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f843a22-8848-4407-b66f-21f735020679 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:26.453880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf1e63-2dbc-49a3-a784-edf920bfdbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:26.454984 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf1e63-2dbc-49a3-a784-edf920bfdbbd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:26.455257 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf1e63-2dbc-49a3-a784-edf920bfdbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:26.455625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf1e63-2dbc-49a3-a784-edf920bfdbbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:26.467750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf1e63-2dbc-49a3-a784-edf920bfdbbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-2ccf1e63-2dbc-49a3-a784-edf920bfdbbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:26.472442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:26.473813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:26.475425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 625/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:26.479858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50340686-acee-4968-99af-d6b91828cd28 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:26.596993 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50340686-acee-4968-99af-d6b91828cd28 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:26.630505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:26.637419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f173-aa64-4a44-aa62-af8d3d6b2c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:26.638628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f173-aa64-4a44-aa62-af8d3d6b2c26 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:26.638628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f173-aa64-4a44-aa62-af8d3d6b2c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:26.638628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f173-aa64-4a44-aa62-af8d3d6b2c26 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:26.639316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601f173-aa64-4a44-aa62-af8d3d6b2c26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:26.639579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601f173-aa64-4a44-aa62-af8d3d6b2c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:26.641178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601f173-aa64-4a44-aa62-af8d3d6b2c26 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:26.651451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 625/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:26.657459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf1e63-2dbc-49a3-a784-edf920bfdbbd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:26.747382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:26.774369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf1e63-2dbc-49a3-a784-edf920bfdbbd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:26.810329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e348773-4b58-4d70-bce3-469b0877f277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:26.810949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e348773-4b58-4d70-bce3-469b0877f277 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:26.811221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e348773-4b58-4d70-bce3-469b0877f277 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:26.811484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e348773-4b58-4d70-bce3-469b0877f277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:26.822836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e348773-4b58-4d70-bce3-469b0877f277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:26.824257 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e348773-4b58-4d70-bce3-469b0877f277 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-5e348773-4b58-4d70-bce3-469b0877f277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:26.838862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:26.840223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:26.841520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:26.841520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:26.841520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:26.841520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 626/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:26.845864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f173-aa64-4a44-aa62-af8d3d6b2c26 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:26.958026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f173-aa64-4a44-aa62-af8d3d6b2c26 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:26.994004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac15abd-34c6-4af0-8bd3-0ee702631faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:26.994611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15abd-34c6-4af0-8bd3-0ee702631faf None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:26.994884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15abd-34c6-4af0-8bd3-0ee702631faf None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:26.995149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15abd-34c6-4af0-8bd3-0ee702631faf None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:26.995786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15abd-34c6-4af0-8bd3-0ee702631faf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:26.996079 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15abd-34c6-4af0-8bd3-0ee702631faf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:26.997550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15abd-34c6-4af0-8bd3-0ee702631faf None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:27.010350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 626/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:27.016324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e348773-4b58-4d70-bce3-469b0877f277 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:27.137543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e348773-4b58-4d70-bce3-469b0877f277 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:27.166800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:27.175508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a424a-e171-4562-8694-791dfa9ea43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:27.176152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a424a-e171-4562-8694-791dfa9ea43e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:27.176431 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a424a-e171-4562-8694-791dfa9ea43e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:27.176729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a424a-e171-4562-8694-791dfa9ea43e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:27.185851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a424a-e171-4562-8694-791dfa9ea43e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:27.187391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a424a-e171-4562-8694-791dfa9ea43e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-f75a424a-e171-4562-8694-791dfa9ea43e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:27.201259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:27.206888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:27.208272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 627/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:12:27.209086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac15abd-34c6-4af0-8bd3-0ee702631faf None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:27.269737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:27.322905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac15abd-34c6-4af0-8bd3-0ee702631faf None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:27.362321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd7371-e674-40e6-a407-2d0f5808e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:27.362978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd7371-e674-40e6-a407-2d0f5808e4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:27.363324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd7371-e674-40e6-a407-2d0f5808e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:27.363660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd7371-e674-40e6-a407-2d0f5808e4b5 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:27.364707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd7371-e674-40e6-a407-2d0f5808e4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:27.364819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd7371-e674-40e6-a407-2d0f5808e4b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:27.367263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd7371-e674-40e6-a407-2d0f5808e4b5 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:27.388682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 627/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:27.394599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a424a-e171-4562-8694-791dfa9ea43e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:27.512101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a424a-e171-4562-8694-791dfa9ea43e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:27.548891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e54c9-9edc-4c63-8c32-5c5cf8653ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:27.549487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e54c9-9edc-4c63-8c32-5c5cf8653ddb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:27.549837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e54c9-9edc-4c63-8c32-5c5cf8653ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:27.550180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e54c9-9edc-4c63-8c32-5c5cf8653ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:27.607754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:27.625381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e54c9-9edc-4c63-8c32-5c5cf8653ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:27.627160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e54c9-9edc-4c63-8c32-5c5cf8653ddb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:27.735676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 628/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:12:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 12:12:27.741679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd7371-e674-40e6-a407-2d0f5808e4b5 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:27.848247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd7371-e674-40e6-a407-2d0f5808e4b5 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:27.862855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:27.885731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578b8e0-1a34-433c-b95d-be8b119fb2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:27.886363 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b8e0-1a34-433c-b95d-be8b119fb2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:27.886656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b8e0-1a34-433c-b95d-be8b119fb2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:27.886913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b8e0-1a34-433c-b95d-be8b119fb2a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:27.897642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578b8e0-1a34-433c-b95d-be8b119fb2a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:27.899212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578b8e0-1a34-433c-b95d-be8b119fb2a1 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-9578b8e0-1a34-433c-b95d-be8b119fb2a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:27.914787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:27.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:27.917039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:27.917039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:27.917039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:27.917039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 628/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:27.921627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e54c9-9edc-4c63-8c32-5c5cf8653ddb None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:28.021700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:28.036759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e54c9-9edc-4c63-8c32-5c5cf8653ddb None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:28.073599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749ce3f-d32e-4fbc-8764-55a3f560dd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:28.074308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749ce3f-d32e-4fbc-8764-55a3f560dd7b None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:28.074681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749ce3f-d32e-4fbc-8764-55a3f560dd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:28.075048 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749ce3f-d32e-4fbc-8764-55a3f560dd7b None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:28.075753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749ce3f-d32e-4fbc-8764-55a3f560dd7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:28.076050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749ce3f-d32e-4fbc-8764-55a3f560dd7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:28.077732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749ce3f-d32e-4fbc-8764-55a3f560dd7b None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:28.090851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 629/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:28.097224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578b8e0-1a34-433c-b95d-be8b119fb2a1 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:28.216796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578b8e0-1a34-433c-b95d-be8b119fb2a1 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:28.253182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99346de2-a240-4256-9d53-23efe14700c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:28.253807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99346de2-a240-4256-9d53-23efe14700c9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:28.254080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99346de2-a240-4256-9d53-23efe14700c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:28.254351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99346de2-a240-4256-9d53-23efe14700c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:28.264696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99346de2-a240-4256-9d53-23efe14700c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:28.266232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99346de2-a240-4256-9d53-23efe14700c9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-99346de2-a240-4256-9d53-23efe14700c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:28.278356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:28.279474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:28.280408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:28.280408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:28.280408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:28.280408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:28.280408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:28.280408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:28.280408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:28.280408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:28.280408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 629/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:28.285378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749ce3f-d32e-4fbc-8764-55a3f560dd7b None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:28.388524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749ce3f-d32e-4fbc-8764-55a3f560dd7b None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:28.426739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b460a-c377-4eda-9848-2ee7ab8dcf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:28.427353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b460a-c377-4eda-9848-2ee7ab8dcf59 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:28.427631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b460a-c377-4eda-9848-2ee7ab8dcf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:28.427902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b460a-c377-4eda-9848-2ee7ab8dcf59 None admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:28.429122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b460a-c377-4eda-9848-2ee7ab8dcf59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:28.429585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b460a-c377-4eda-9848-2ee7ab8dcf59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:28.431147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b460a-c377-4eda-9848-2ee7ab8dcf59 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:28.451208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 630/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:28.452431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99346de2-a240-4256-9d53-23efe14700c9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:28.481214 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:28.559486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99346de2-a240-4256-9d53-23efe14700c9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:28.594348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041c6ca-1597-460a-9c80-396dceb75e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:28.594932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c6ca-1597-460a-9c80-396dceb75e26 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:28.595245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c6ca-1597-460a-9c80-396dceb75e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:28.595515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c6ca-1597-460a-9c80-396dceb75e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:28.596280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041c6ca-1597-460a-9c80-396dceb75e26 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=c7f2e22ace8648919104c910c74c1711) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:28.596580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041c6ca-1597-460a-9c80-396dceb75e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:28.598048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041c6ca-1597-460a-9c80-396dceb75e26 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:28.603848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 630/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:12:28 2022] GET /identity/v3/role_assignments?user.id=c7f2e22ace8648919104c910c74c1711&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=d6155b01aace49f887f29aa2861d31cf => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:30.591636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6af8-ea35-4207-9b12-0e2d4ad01259 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:30.592161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6af8-ea35-4207-9b12-0e2d4ad01259 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:30.592161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f6af8-ea35-4207-9b12-0e2d4ad01259 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:30.593534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 631/1261] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:30.598639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bd6d4-34af-44fd-9d4a-cc8f8044e58d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:30.599064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bd6d4-34af-44fd-9d4a-cc8f8044e58d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:30.599155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bd6d4-34af-44fd-9d4a-cc8f8044e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:30.617339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-fe8bd6d4-34af-44fd-9d4a-cc8f8044e58d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:30.618497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-fe8bd6d4-34af-44fd-9d4a-cc8f8044e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:30.682699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 631/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:30.705020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6af8-ea35-4207-9b12-0e2d4ad01259 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:30.715488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:30.800996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f6af8-ea35-4207-9b12-0e2d4ad01259 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:30.833422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e9429-6829-401c-b695-e18e825af7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:30.834021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e9429-6829-401c-b695-e18e825af7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:30.834340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e9429-6829-401c-b695-e18e825af7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:30.834598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e9429-6829-401c-b695-e18e825af7d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:30.844098 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e9429-6829-401c-b695-e18e825af7d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-9f1e9429-6829-401c-b695-e18e825af7d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:30.848646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:30.849748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:30.850896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 632/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:12:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:12:30.855574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bd6d4-34af-44fd-9d4a-cc8f8044e58d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:30.873755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:30.952248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bd6d4-34af-44fd-9d4a-cc8f8044e58d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:30.984896 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad0d03-683c-4070-b78d-34bfd0a54622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:30.985479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad0d03-683c-4070-b78d-34bfd0a54622 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:30.985751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad0d03-683c-4070-b78d-34bfd0a54622 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:30.986014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad0d03-683c-4070-b78d-34bfd0a54622 None admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:30.986655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad0d03-683c-4070-b78d-34bfd0a54622 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:30.986949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad0d03-683c-4070-b78d-34bfd0a54622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:30.988292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad0d03-683c-4070-b78d-34bfd0a54622 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:30.996649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 632/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:31.002193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e9429-6829-401c-b695-e18e825af7d5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:31.067429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:31.100448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e9429-6829-401c-b695-e18e825af7d5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:31.136178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48b213-bed6-4c82-8627-a2d64af717fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:31.136825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48b213-bed6-4c82-8627-a2d64af717fd None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:31.137105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48b213-bed6-4c82-8627-a2d64af717fd None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:31.137374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48b213-bed6-4c82-8627-a2d64af717fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:31.147172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48b213-bed6-4c82-8627-a2d64af717fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:31.148589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48b213-bed6-4c82-8627-a2d64af717fd None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-4e48b213-bed6-4c82-8627-a2d64af717fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:31.162988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:31.164165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:31.165606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:31.165606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:31.165606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:31.165606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 633/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:31.169799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad0d03-683c-4070-b78d-34bfd0a54622 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:31.252445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:31.270965 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad0d03-683c-4070-b78d-34bfd0a54622 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:31.303963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452910d-0e39-4c20-a53e-f23a25c118b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:31.304581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452910d-0e39-4c20-a53e-f23a25c118b4 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:31.304886 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452910d-0e39-4c20-a53e-f23a25c118b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:31.305152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452910d-0e39-4c20-a53e-f23a25c118b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:31.305773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452910d-0e39-4c20-a53e-f23a25c118b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:31.306068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452910d-0e39-4c20-a53e-f23a25c118b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:31.307414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452910d-0e39-4c20-a53e-f23a25c118b4 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:31.318593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 633/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:31.324298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48b213-bed6-4c82-8627-a2d64af717fd None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:31.421429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48b213-bed6-4c82-8627-a2d64af717fd None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:31.440638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:31.454843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d51dd-7b83-44f4-b364-90e49a9cfded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:31.455460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d51dd-7b83-44f4-b364-90e49a9cfded None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:31.455740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d51dd-7b83-44f4-b364-90e49a9cfded None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:31.456009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d51dd-7b83-44f4-b364-90e49a9cfded None admin] PATH_INFO: `/v3/users/placement` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:31.464681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d51dd-7b83-44f4-b364-90e49a9cfded None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:31.466107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d51dd-7b83-44f4-b364-90e49a9cfded None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-e71d51dd-7b83-44f4-b364-90e49a9cfded None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:31.477377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:31.478465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:31.479842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 634/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:31.484196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452910d-0e39-4c20-a53e-f23a25c118b4 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:31.580965 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452910d-0e39-4c20-a53e-f23a25c118b4 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:31.614682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeebd19-8714-4066-ac3e-df976dabded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:31.615264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeebd19-8714-4066-ac3e-df976dabded8 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:31.615632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeebd19-8714-4066-ac3e-df976dabded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:31.616089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeebd19-8714-4066-ac3e-df976dabded8 None admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:31.616932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeebd19-8714-4066-ac3e-df976dabded8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:31.617237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeebd19-8714-4066-ac3e-df976dabded8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:31.618665 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeebd19-8714-4066-ac3e-df976dabded8 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:31.626943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:31.635654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 634/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:31.641177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d51dd-7b83-44f4-b364-90e49a9cfded None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:31.737516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d51dd-7b83-44f4-b364-90e49a9cfded None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:31.769420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43f9d1-bd17-4c46-bf56-d722063d99d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:31.770018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43f9d1-bd17-4c46-bf56-d722063d99d5 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:31.770294 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43f9d1-bd17-4c46-bf56-d722063d99d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:31.770561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43f9d1-bd17-4c46-bf56-d722063d99d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:31.783799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43f9d1-bd17-4c46-bf56-d722063d99d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:31.786546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43f9d1-bd17-4c46-bf56-d722063d99d5 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-eb43f9d1-bd17-4c46-bf56-d722063d99d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:31.803491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:31.805451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:31.806501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:31.806501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:31.806501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:31.806501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 635/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:31.810242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeebd19-8714-4066-ac3e-df976dabded8 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:31.912717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeebd19-8714-4066-ac3e-df976dabded8 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:31.946099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca6d02-1169-40a6-b1ea-92120a622bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:31.946682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca6d02-1169-40a6-b1ea-92120a622bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:31.946962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca6d02-1169-40a6-b1ea-92120a622bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:31.947232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca6d02-1169-40a6-b1ea-92120a622bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:31.947859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca6d02-1169-40a6-b1ea-92120a622bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:31.948158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca6d02-1169-40a6-b1ea-92120a622bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:31.949551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca6d02-1169-40a6-b1ea-92120a622bb9 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:31.960947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 635/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:31.966460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43f9d1-bd17-4c46-bf56-d722063d99d5 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:31.996551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:32.063779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43f9d1-bd17-4c46-bf56-d722063d99d5 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:32.096931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a420c39-7c2a-4376-990a-2ffb377579ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:32.097544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420c39-7c2a-4376-990a-2ffb377579ba None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:32.097814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420c39-7c2a-4376-990a-2ffb377579ba None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:32.098080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420c39-7c2a-4376-990a-2ffb377579ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:32.105162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a420c39-7c2a-4376-990a-2ffb377579ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:32.106526 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a420c39-7c2a-4376-990a-2ffb377579ba None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-9a420c39-7c2a-4376-990a-2ffb377579ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:32.118358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:32.119452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:32.120952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:32.120952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:32.120952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:32.120952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:32.120952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:32.120952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:32.120952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:32.120952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:32.120952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 636/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:32.125297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca6d02-1169-40a6-b1ea-92120a622bb9 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:32.184861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:32.226964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca6d02-1169-40a6-b1ea-92120a622bb9 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:32.260117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ae4fb-8282-4815-b4b3-242e7cbc7855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:32.260740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ae4fb-8282-4815-b4b3-242e7cbc7855 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:32.261021 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ae4fb-8282-4815-b4b3-242e7cbc7855 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:32.261290 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ae4fb-8282-4815-b4b3-242e7cbc7855 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:32.261968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ae4fb-8282-4815-b4b3-242e7cbc7855 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:32.262273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ae4fb-8282-4815-b4b3-242e7cbc7855 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:32.263700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ae4fb-8282-4815-b4b3-242e7cbc7855 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:32.275430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 636/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:32.281377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a420c39-7c2a-4376-990a-2ffb377579ba None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:32.370117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:32.378852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a420c39-7c2a-4376-990a-2ffb377579ba None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:32.411349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0fbb0-e33d-48e1-95d4-e388ba18c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:32.411997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0fbb0-e33d-48e1-95d4-e388ba18c9da None admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:32.412301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0fbb0-e33d-48e1-95d4-e388ba18c9da None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:32.412777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0fbb0-e33d-48e1-95d4-e388ba18c9da None admin] PATH_INFO: `/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/c7f2e22ace8648919104c910c74c1711/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:32.414705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0fbb0-e33d-48e1-95d4-e388ba18c9da None admin] RBAC: Authorizing `identity:create_grant(project_id=50132e2ee6734b119ec58f32acdc3add, user_id=c7f2e22ace8648919104c910c74c1711, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:32.416121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0fbb0-e33d-48e1-95d4-e388ba18c9da None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:32.429512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 637/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Aug 9 12:12:32 2022] PUT /identity/v3/projects/50132e2ee6734b119ec58f32acdc3add/users/c7f2e22ace8648919104c910c74c1711/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:12:34.393051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203822c-12b9-44cb-8519-b1caf0240ac4 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:34.393582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203822c-12b9-44cb-8519-b1caf0240ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:34.393582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203822c-12b9-44cb-8519-b1caf0240ac4 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:34.394928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 637/1274] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:34.400873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733864da-7d7b-4600-8e45-eb97103b14cd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:34.401286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733864da-7d7b-4600-8e45-eb97103b14cd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:34.401405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733864da-7d7b-4600-8e45-eb97103b14cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:34.419841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-733864da-7d7b-4600-8e45-eb97103b14cd None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:34.421056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-733864da-7d7b-4600-8e45-eb97103b14cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:34.485860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 638/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:34.509382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203822c-12b9-44cb-8519-b1caf0240ac4 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:34.608496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203822c-12b9-44cb-8519-b1caf0240ac4 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:34.625244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:34.641693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eecb09-370f-46f5-bd5e-cc4e4d678719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:34.642308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eecb09-370f-46f5-bd5e-cc4e4d678719 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:34.642584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eecb09-370f-46f5-bd5e-cc4e4d678719 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:34.642851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eecb09-370f-46f5-bd5e-cc4e4d678719 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:34.653246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eecb09-370f-46f5-bd5e-cc4e4d678719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-18eecb09-370f-46f5-bd5e-cc4e4d678719 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:34.657846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:34.658946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:34.659791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 638/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Aug 9 12:12:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:34.665829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733864da-7d7b-4600-8e45-eb97103b14cd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:34.744353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:34.763106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733864da-7d7b-4600-8e45-eb97103b14cd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:34.796388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb04f-8a21-47b9-b8ef-41870ba11b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:34.797009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb04f-8a21-47b9-b8ef-41870ba11b9a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:34.797535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb04f-8a21-47b9-b8ef-41870ba11b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:34.797796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb04f-8a21-47b9-b8ef-41870ba11b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:34.798443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccb04f-8a21-47b9-b8ef-41870ba11b9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:34.798738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccb04f-8a21-47b9-b8ef-41870ba11b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:34.800081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccb04f-8a21-47b9-b8ef-41870ba11b9a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:34.807837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 639/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Aug 9 12:12:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:34.813664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eecb09-370f-46f5-bd5e-cc4e4d678719 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:34.910810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eecb09-370f-46f5-bd5e-cc4e4d678719 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:34.942908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a63aa3-d902-462d-a17d-3de846d6e9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:34.944061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a63aa3-d902-462d-a17d-3de846d6e9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:34.944332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a63aa3-d902-462d-a17d-3de846d6e9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:34.944596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a63aa3-d902-462d-a17d-3de846d6e9e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:34.954221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a63aa3-d902-462d-a17d-3de846d6e9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:34.955641 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a63aa3-d902-462d-a17d-3de846d6e9e6 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-24a63aa3-d902-462d-a17d-3de846d6e9e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:34.970075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:34.971175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:34.972296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:34.972296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:34.972296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:34.972296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 639/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:34.976899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb04f-8a21-47b9-b8ef-41870ba11b9a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:35.073343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb04f-8a21-47b9-b8ef-41870ba11b9a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:35.109919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80782ecc-c1c8-4d46-afc2-2e5d051b9ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:35.110519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80782ecc-c1c8-4d46-afc2-2e5d051b9ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:35.110791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80782ecc-c1c8-4d46-afc2-2e5d051b9ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:35.111058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80782ecc-c1c8-4d46-afc2-2e5d051b9ea1 None admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:35.111693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80782ecc-c1c8-4d46-afc2-2e5d051b9ea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:35.111991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80782ecc-c1c8-4d46-afc2-2e5d051b9ea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:35.113376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80782ecc-c1c8-4d46-afc2-2e5d051b9ea1 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:35.125998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 640/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:35.132769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a63aa3-d902-462d-a17d-3de846d6e9e6 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:35.162810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:35.231318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a63aa3-d902-462d-a17d-3de846d6e9e6 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:35.264778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7b458-6643-41b5-b740-bfe435da6d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:35.265391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b458-6643-41b5-b740-bfe435da6d56 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:35.265664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b458-6643-41b5-b740-bfe435da6d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:35.265927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b458-6643-41b5-b740-bfe435da6d56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:35.273167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7b458-6643-41b5-b740-bfe435da6d56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:35.274599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7b458-6643-41b5-b740-bfe435da6d56 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-feb7b458-6643-41b5-b740-bfe435da6d56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:35.285048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:35.286125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:35.287253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 640/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:35.291848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80782ecc-c1c8-4d46-afc2-2e5d051b9ea1 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:35.295579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:35.390106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80782ecc-c1c8-4d46-afc2-2e5d051b9ea1 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:35.422875 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fb8a6-55c4-46ec-982a-8b432952b91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:35.423463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fb8a6-55c4-46ec-982a-8b432952b91a None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:35.423736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fb8a6-55c4-46ec-982a-8b432952b91a None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:35.424001 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fb8a6-55c4-46ec-982a-8b432952b91a None admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:35.424745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fb8a6-55c4-46ec-982a-8b432952b91a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:35.425048 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fb8a6-55c4-46ec-982a-8b432952b91a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:35.426459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fb8a6-55c4-46ec-982a-8b432952b91a None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:35.444208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 641/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:35.450164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7b458-6643-41b5-b740-bfe435da6d56 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:35.538563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:35.548718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7b458-6643-41b5-b740-bfe435da6d56 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:35.581521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89b4e-5f7f-4b9f-9353-50f14c4fa5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:35.582111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89b4e-5f7f-4b9f-9353-50f14c4fa5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:35.582387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89b4e-5f7f-4b9f-9353-50f14c4fa5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:35.582653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89b4e-5f7f-4b9f-9353-50f14c4fa5a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:35.647388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89b4e-5f7f-4b9f-9353-50f14c4fa5a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:35.648861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89b4e-5f7f-4b9f-9353-50f14c4fa5a8 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:35.735245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:35.746056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 641/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Aug 9 12:12:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:12:35.751853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fb8a6-55c4-46ec-982a-8b432952b91a None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:35.811526 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:35.854938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fb8a6-55c4-46ec-982a-8b432952b91a None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:35.887159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd469a-6bca-422e-8c32-3e794e01f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:35.887779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd469a-6bca-422e-8c32-3e794e01f28e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:35.888056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd469a-6bca-422e-8c32-3e794e01f28e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:35.888325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd469a-6bca-422e-8c32-3e794e01f28e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:35.898527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd469a-6bca-422e-8c32-3e794e01f28e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:35.899940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd469a-6bca-422e-8c32-3e794e01f28e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-00bd469a-6bca-422e-8c32-3e794e01f28e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:35.914325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:35.915403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:35.916454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:35.916454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:35.916454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:35.916454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 642/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:35.921096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89b4e-5f7f-4b9f-9353-50f14c4fa5a8 None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:36.016330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89b4e-5f7f-4b9f-9353-50f14c4fa5a8 None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:36.048319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f21e6-2981-4f30-89fa-a782c90ab2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:36.048934 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f21e6-2981-4f30-89fa-a782c90ab2fc None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:36.049208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f21e6-2981-4f30-89fa-a782c90ab2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:36.049469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f21e6-2981-4f30-89fa-a782c90ab2fc None admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:36.050083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f21e6-2981-4f30-89fa-a782c90ab2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:36.050377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f21e6-2981-4f30-89fa-a782c90ab2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:36.051718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f21e6-2981-4f30-89fa-a782c90ab2fc None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:36.062906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 642/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:36.069355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd469a-6bca-422e-8c32-3e794e01f28e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:36.173083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd469a-6bca-422e-8c32-3e794e01f28e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:36.186600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:36.207082 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647db4d-345c-4db6-bca8-04d605a4cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:36.207694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647db4d-345c-4db6-bca8-04d605a4cb71 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:36.207967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647db4d-345c-4db6-bca8-04d605a4cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:36.208233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647db4d-345c-4db6-bca8-04d605a4cb71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:36.214696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647db4d-345c-4db6-bca8-04d605a4cb71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:36.216099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647db4d-345c-4db6-bca8-04d605a4cb71 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application [None req-4647db4d-345c-4db6-bca8-04d605a4cb71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:36.228172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:36.229249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:36.230386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:36.230386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:36.230386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:36.230386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:36.230386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:36.230386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:36.230386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:36.230386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: ERROR keystone.server.flask.application Aug 09 12:12:36.230386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 643/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:36.235227 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f21e6-2981-4f30-89fa-a782c90ab2fc None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:36.284239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:36.334584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f21e6-2981-4f30-89fa-a782c90ab2fc None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:36.366336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb87fca-04aa-47ee-b1e5-a9dc46ef2ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:36.366915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87fca-04aa-47ee-b1e5-a9dc46ef2ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:36.367188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87fca-04aa-47ee-b1e5-a9dc46ef2ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:36.367450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87fca-04aa-47ee-b1e5-a9dc46ef2ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:36.368122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb87fca-04aa-47ee-b1e5-a9dc46ef2ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:36.368418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb87fca-04aa-47ee-b1e5-a9dc46ef2ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:36.369855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb87fca-04aa-47ee-b1e5-a9dc46ef2ba2 None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:36.381864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 643/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:36.387726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647db4d-345c-4db6-bca8-04d605a4cb71 None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:36.483283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647db4d-345c-4db6-bca8-04d605a4cb71 None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:36.515205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f21c1-d41a-4b6e-ab6f-e297211c5dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:36.515784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f21c1-d41a-4b6e-ab6f-e297211c5dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:36.516054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f21c1-d41a-4b6e-ab6f-e297211c5dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:36.516314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f21c1-d41a-4b6e-ab6f-e297211c5dd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:36.517043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f21c1-d41a-4b6e-ab6f-e297211c5dd3 None admin] RBAC: Adding query filter params (role.id=d6155b01aace49f887f29aa2861d31cf, scope.project.id=50132e2ee6734b119ec58f32acdc3add, user.id=c7f2e22ace8648919104c910c74c1711) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:36.517342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f21c1-d41a-4b6e-ab6f-e297211c5dd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:36.518756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f21c1-d41a-4b6e-ab6f-e297211c5dd3 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:36.525038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 644/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Aug 9 12:12:36 2022] GET /identity/v3/role_assignments?user.id=c7f2e22ace8648919104c910c74c1711&scope.project.id=50132e2ee6734b119ec58f32acdc3add&role.id=d6155b01aace49f887f29aa2861d31cf => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:38.535699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9f76d-c126-4090-8758-c51dbe30f233 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:38.536218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9f76d-c126-4090-8758-c51dbe30f233 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:38.536218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9f76d-c126-4090-8758-c51dbe30f233 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:38.538165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 644/1288] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:38.543297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89aa6d-d0cf-4a8e-b267-8767f90619ce None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:38.543673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89aa6d-d0cf-4a8e-b267-8767f90619ce None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:38.543844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89aa6d-d0cf-4a8e-b267-8767f90619ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:38.562216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-db89aa6d-d0cf-4a8e-b267-8767f90619ce None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:38.563385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-db89aa6d-d0cf-4a8e-b267-8767f90619ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:38.591994 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:38.629015 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 645/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:38.652628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9f76d-c126-4090-8758-c51dbe30f233 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:38.751660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9f76d-c126-4090-8758-c51dbe30f233 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:38.762594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:38.785765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462713ff-7620-47c2-9474-e4abd645624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:38.786368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462713ff-7620-47c2-9474-e4abd645624b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:38.786640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462713ff-7620-47c2-9474-e4abd645624b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:38.786923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462713ff-7620-47c2-9474-e4abd645624b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:38.787829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462713ff-7620-47c2-9474-e4abd645624b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:38.789238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462713ff-7620-47c2-9474-e4abd645624b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-462713ff-7620-47c2-9474-e4abd645624b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:38.797701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:38.798991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:38.800026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 645/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 9 12:12:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:38.807127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89aa6d-d0cf-4a8e-b267-8767f90619ce None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:38.902708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89aa6d-d0cf-4a8e-b267-8767f90619ce None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:38.935258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb2246-30a6-43a0-a48b-29718e83696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:38.935840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb2246-30a6-43a0-a48b-29718e83696d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:38.936112 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb2246-30a6-43a0-a48b-29718e83696d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:38.936378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb2246-30a6-43a0-a48b-29718e83696d None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:38.937020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb2246-30a6-43a0-a48b-29718e83696d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:38.937316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb2246-30a6-43a0-a48b-29718e83696d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:38.938656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb2246-30a6-43a0-a48b-29718e83696d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:38.944080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 646/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Aug 9 12:12:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:38.949541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462713ff-7620-47c2-9474-e4abd645624b None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:39.045606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462713ff-7620-47c2-9474-e4abd645624b None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:39.078818 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769047d6-2267-4db6-98cc-a1c6e4977a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:39.079401 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769047d6-2267-4db6-98cc-a1c6e4977a6b None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:39.079679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769047d6-2267-4db6-98cc-a1c6e4977a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:39.079947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769047d6-2267-4db6-98cc-a1c6e4977a6b None admin] PATH_INFO: `/v3/services` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:39.080562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769047d6-2267-4db6-98cc-a1c6e4977a6b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:39.080890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769047d6-2267-4db6-98cc-a1c6e4977a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:39.082242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769047d6-2267-4db6-98cc-a1c6e4977a6b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:39.086600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 646/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Aug 9 12:12:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:41.108199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dffc9-f292-43ec-9fd7-7da53e3914cf None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:41.108903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dffc9-f292-43ec-9fd7-7da53e3914cf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:41.108903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dffc9-f292-43ec-9fd7-7da53e3914cf None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:41.110127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 647/1293] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:41.115551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f42e33-1a10-4ffc-a8ce-190a5db762fc None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:41.116050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f42e33-1a10-4ffc-a8ce-190a5db762fc None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:41.116201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f42e33-1a10-4ffc-a8ce-190a5db762fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:41.135879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a2f42e33-1a10-4ffc-a8ce-190a5db762fc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:41.137208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a2f42e33-1a10-4ffc-a8ce-190a5db762fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:41.170521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:41.207148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 647/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:12:41.230473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dffc9-f292-43ec-9fd7-7da53e3914cf None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:41.260199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:41.327351 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dffc9-f292-43ec-9fd7-7da53e3914cf None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:41.359764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21a46-6473-4f4f-b866-84480602e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:41.360283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21a46-6473-4f4f-b866-84480602e4f7 None admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:41.360555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21a46-6473-4f4f-b866-84480602e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:41.360848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21a46-6473-4f4f-b866-84480602e4f7 None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:41.361479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21a46-6473-4f4f-b866-84480602e4f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:41.362820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21a46-6473-4f4f-b866-84480602e4f7 None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:41.376333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 648/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Aug 9 12:12:41 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:12:43.365108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b83e54-9fec-4c49-92a6-0306e91708bb None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:43.365657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b83e54-9fec-4c49-92a6-0306e91708bb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:43.365657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b83e54-9fec-4c49-92a6-0306e91708bb None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:43.367002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 648/1296] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:43.371967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c19d-31b6-4ad2-939f-e084c44ecfe4 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:43.372394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c19d-31b6-4ad2-939f-e084c44ecfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:43.372516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5c19d-31b6-4ad2-939f-e084c44ecfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:43.390006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fdf5c19d-31b6-4ad2-939f-e084c44ecfe4 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:43.391169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fdf5c19d-31b6-4ad2-939f-e084c44ecfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:43.462871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 649/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:43.485394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b83e54-9fec-4c49-92a6-0306e91708bb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:43.583419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b83e54-9fec-4c49-92a6-0306e91708bb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:43.617274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d20ea0-aa3e-4b50-a543-07c5c4cdbf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:43.617816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d20ea0-aa3e-4b50-a543-07c5c4cdbf7a None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:43.618088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d20ea0-aa3e-4b50-a543-07c5c4cdbf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:43.618350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d20ea0-aa3e-4b50-a543-07c5c4cdbf7a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:43.618908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d20ea0-aa3e-4b50-a543-07c5c4cdbf7a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:43.620252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d20ea0-aa3e-4b50-a543-07c5c4cdbf7a None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-f3d20ea0-aa3e-4b50-a543-07c5c4cdbf7a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:43.628487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:43.629814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:43.631114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 649/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 9 12:12:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:43.635658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5c19d-31b6-4ad2-939f-e084c44ecfe4 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:43.653950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:43.733469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5c19d-31b6-4ad2-939f-e084c44ecfe4 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:43.766894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfa490-d111-40ef-b235-d3cc0019ed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:43.767483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfa490-d111-40ef-b235-d3cc0019ed3e None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:43.767758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfa490-d111-40ef-b235-d3cc0019ed3e None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:43.768026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfa490-d111-40ef-b235-d3cc0019ed3e None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:43.768663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfa490-d111-40ef-b235-d3cc0019ed3e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:43.768969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfa490-d111-40ef-b235-d3cc0019ed3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:43.770322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfa490-d111-40ef-b235-d3cc0019ed3e None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:43.775871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 650/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Aug 9 12:12:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:43.781678 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d20ea0-aa3e-4b50-a543-07c5c4cdbf7a None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:43.812235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:43.877558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d20ea0-aa3e-4b50-a543-07c5c4cdbf7a None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:43.910367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c47ec-c1bf-4fca-85cf-574ad87fac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:43.910951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c47ec-c1bf-4fca-85cf-574ad87fac8f None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:43.911225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c47ec-c1bf-4fca-85cf-574ad87fac8f None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:43.911489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c47ec-c1bf-4fca-85cf-574ad87fac8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:43.912306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c47ec-c1bf-4fca-85cf-574ad87fac8f None admin] RBAC: Adding query filter params (interface=public, service_id=4a2dc60afa6a4abd8c9816937595893c, region_id=RegionOne) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:43.912607 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c47ec-c1bf-4fca-85cf-574ad87fac8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:43.913997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c47ec-c1bf-4fca-85cf-574ad87fac8f None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:43.918938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 650/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Aug 9 12:12:43 2022] GET /identity/v3/endpoints?service_id=4a2dc60afa6a4abd8c9816937595893c&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:43.925256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfa490-d111-40ef-b235-d3cc0019ed3e None admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:44.004242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:44.022977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfa490-d111-40ef-b235-d3cc0019ed3e None admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:44.055262 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e721-78e0-4641-b97b-fb5296eedceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:44.055845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e721-78e0-4641-b97b-fb5296eedceb None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:44.056150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e721-78e0-4641-b97b-fb5296eedceb None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:44.056422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e721-78e0-4641-b97b-fb5296eedceb None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:44.057040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70e721-78e0-4641-b97b-fb5296eedceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:44.058388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70e721-78e0-4641-b97b-fb5296eedceb None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:44.065118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 651/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Aug 9 12:12:43 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:12:46.229468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d890b0-7405-4a98-a166-47a221050a5e None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:46.230031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d890b0-7405-4a98-a166-47a221050a5e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:46.230031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d890b0-7405-4a98-a166-47a221050a5e None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:46.231353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 651/1302] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:46.236315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b0d8c-1223-46f8-9028-655c70aaae44 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:46.236788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b0d8c-1223-46f8-9028-655c70aaae44 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:46.236887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b0d8c-1223-46f8-9028-655c70aaae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:46.254998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-085b0d8c-1223-46f8-9028-655c70aaae44 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:46.256214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-085b0d8c-1223-46f8-9028-655c70aaae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:46.322285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 652/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:46.345286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d890b0-7405-4a98-a166-47a221050a5e None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:46.438570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:46.445935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d890b0-7405-4a98-a166-47a221050a5e None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:46.479808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc6aa6-4f06-4868-b756-ff2c0973779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:46.480351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6aa6-4f06-4868-b756-ff2c0973779d None admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:46.480655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6aa6-4f06-4868-b756-ff2c0973779d None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:46.480916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6aa6-4f06-4868-b756-ff2c0973779d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:46.481486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc6aa6-4f06-4868-b756-ff2c0973779d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:46.482831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc6aa6-4f06-4868-b756-ff2c0973779d None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application [None req-8cdc6aa6-4f06-4868-b756-ff2c0973779d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:46.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:46.492797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: ERROR keystone.server.flask.application Aug 09 12:12:46.493930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 652/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Aug 9 12:12:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:46.498679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b0d8c-1223-46f8-9028-655c70aaae44 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:46.571981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:46.594825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b0d8c-1223-46f8-9028-655c70aaae44 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:46.627587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dacfb0-91fd-49dc-bba9-ebf67e73c93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:46.628187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dacfb0-91fd-49dc-bba9-ebf67e73c93d None admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:46.628461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dacfb0-91fd-49dc-bba9-ebf67e73c93d None admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:46.628761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dacfb0-91fd-49dc-bba9-ebf67e73c93d None admin] PATH_INFO: `/v3/services` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:46.629381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dacfb0-91fd-49dc-bba9-ebf67e73c93d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:46.629677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dacfb0-91fd-49dc-bba9-ebf67e73c93d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:46.631063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dacfb0-91fd-49dc-bba9-ebf67e73c93d None admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:46.636099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 653/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Aug 9 12:12:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:46.642123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc6aa6-4f06-4868-b756-ff2c0973779d None admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:46.740794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc6aa6-4f06-4868-b756-ff2c0973779d None admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:46.773761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391cc96-8f7d-46cd-a5a7-a8c4645b604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:46.774341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391cc96-8f7d-46cd-a5a7-a8c4645b604b None admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:46.774616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391cc96-8f7d-46cd-a5a7-a8c4645b604b None admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:46.774883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391cc96-8f7d-46cd-a5a7-a8c4645b604b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:46.775520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391cc96-8f7d-46cd-a5a7-a8c4645b604b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:46.776909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391cc96-8f7d-46cd-a5a7-a8c4645b604b None admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:46.796113 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 653/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:12:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:12:56.633887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=30 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:56.792046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:50.494160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629341-df67-4bf8-be9b-2e11dac2abb8 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:50.494760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629341-df67-4bf8-be9b-2e11dac2abb8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:50.494760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629341-df67-4bf8-be9b-2e11dac2abb8 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:50.499937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 654/1307] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:13:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:13:50.501670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53cf07-d7a2-462d-a04e-dc5484915090 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:50.502072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53cf07-d7a2-462d-a04e-dc5484915090 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:50.502695 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53cf07-d7a2-462d-a04e-dc5484915090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:50.589552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ae53cf07-d7a2-462d-a04e-dc5484915090 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:13:50.590824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ae53cf07-d7a2-462d-a04e-dc5484915090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:50.731710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 654/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:13:50.792835 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9657d7e-b0a4-45cf-b206-29d475fa44a6 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:50.793482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9657d7e-b0a4-45cf-b206-29d475fa44a6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:50.793969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9657d7e-b0a4-45cf-b206-29d475fa44a6 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:50.796087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 655/1309] 10.222.0.25 () {54 vars in 965 bytes} [Tue Aug 9 12:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:13:50.808017 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8125ca-ca03-4e23-bfe3-b0bbbbe34cca None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:50.808830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8125ca-ca03-4e23-bfe3-b0bbbbe34cca None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:50.809340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8125ca-ca03-4e23-bfe3-b0bbbbe34cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:50.900391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-0b8125ca-ca03-4e23-bfe3-b0bbbbe34cca None None] MFA Rules not processed for user `13063cbf860c4ca98666500c3c125933`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:13:50.901798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0b8125ca-ca03-4e23-bfe3-b0bbbbe34cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:50.924404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:50.983872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 655/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Tue Aug 9 12:13:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:13:50.993562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9657d7e-b0a4-45cf-b206-29d475fa44a6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:50.995492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e9657d7e-b0a4-45cf-b206-29d475fa44a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:51.117201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9657d7e-b0a4-45cf-b206-29d475fa44a6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:51.195958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23b609-bed2-4187-af4f-964b4b603cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:51.196472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b609-bed2-4187-af4f-964b4b603cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:51.196772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b609-bed2-4187-af4f-964b4b603cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:51.197035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b609-bed2-4187-af4f-964b4b603cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:51.198612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2f23b609-bed2-4187-af4f-964b4b603cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:51.265132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:51.334634 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23b609-bed2-4187-af4f-964b4b603cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:51.336204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23b609-bed2-4187-af4f-964b4b603cc5 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:51.357440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 656/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:13:53.701438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb518086-cd20-46dc-a78d-6703ab748f2b None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:53.701987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb518086-cd20-46dc-a78d-6703ab748f2b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:53.701987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb518086-cd20-46dc-a78d-6703ab748f2b None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:53.708307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 656/1312] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:13:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:13:53.710051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d76895-0d39-4456-85c4-630e90eb9321 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:53.710533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d76895-0d39-4456-85c4-630e90eb9321 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:53.710614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d76895-0d39-4456-85c4-630e90eb9321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:53.803123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-15d76895-0d39-4456-85c4-630e90eb9321 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:13:53.804668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-15d76895-0d39-4456-85c4-630e90eb9321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:53.922867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 657/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:13:53.970053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f8c77-f21e-4f74-894b-b21251a548df None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:53.970515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f8c77-f21e-4f74-894b-b21251a548df None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:53.970515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f8c77-f21e-4f74-894b-b21251a548df None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:53.973236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 657/1314] 10.222.0.25 () {54 vars in 965 bytes} [Tue Aug 9 12:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:13:53.979270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9112c40-3307-49c5-a02a-be2ec85a4892 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:53.979562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9112c40-3307-49c5-a02a-be2ec85a4892 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:53.979834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9112c40-3307-49c5-a02a-be2ec85a4892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:53.991985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:54.059369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b9112c40-3307-49c5-a02a-be2ec85a4892 None None] MFA Rules not processed for user `13063cbf860c4ca98666500c3c125933`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:13:54.060597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b9112c40-3307-49c5-a02a-be2ec85a4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:54.139699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 658/1315] 10.222.0.25 () {58 vars in 1062 bytes} [Tue Aug 9 12:13:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:13:54.149582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f8c77-f21e-4f74-894b-b21251a548df None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:54.151156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d94f8c77-f21e-4f74-894b-b21251a548df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:54.257200 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f8c77-f21e-4f74-894b-b21251a548df None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:54.327355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:54.331128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2d01e-4247-46b8-afa4-a2297aab79b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:54.331945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2d01e-4247-46b8-afa4-a2297aab79b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:54.332409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2d01e-4247-46b8-afa4-a2297aab79b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:54.332880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2d01e-4247-46b8-afa4-a2297aab79b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:54.334509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0ab2d01e-4247-46b8-afa4-a2297aab79b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:54.445248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2d01e-4247-46b8-afa4-a2297aab79b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:54.446680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2d01e-4247-46b8-afa4-a2297aab79b4 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:54.464692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 658/1316] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:13:56.987236 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d23851-f3c0-48bb-9151-5058e3b0dbb0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:56.987774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d23851-f3c0-48bb-9151-5058e3b0dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:56.987774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d23851-f3c0-48bb-9151-5058e3b0dbb0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:56.989164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 659/1317] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:13:56.994229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706376-1621-4ff4-930d-46932ca7c2e8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:56.994632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706376-1621-4ff4-930d-46932ca7c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:56.994768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706376-1621-4ff4-930d-46932ca7c2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:57.059835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-66706376-1621-4ff4-930d-46932ca7c2e8 None None] MFA Rules not processed for user `7641ad2083f64ed5abf305699dc5b1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:13:57.061057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-66706376-1621-4ff4-930d-46932ca7c2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:57.112021 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:57.156168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 659/1318] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:13:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:13:57.196398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d23851-f3c0-48bb-9151-5058e3b0dbb0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:57.197964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-35d23851-f3c0-48bb-9151-5058e3b0dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:57.298777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d23851-f3c0-48bb-9151-5058e3b0dbb0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:57.301521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:57.369893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dec0f9-9676-485d-ac2a-6b795395c058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:57.370513 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec0f9-9676-485d-ac2a-6b795395c058 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:57.370789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec0f9-9676-485d-ac2a-6b795395c058 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:57.371052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec0f9-9676-485d-ac2a-6b795395c058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:57.372646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c6dec0f9-9676-485d-ac2a-6b795395c058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:57.479568 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec0f9-9676-485d-ac2a-6b795395c058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:57.481030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec0f9-9676-485d-ac2a-6b795395c058 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:57.498524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 660/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:13:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:00.066525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706495b5-97d1-49df-be01-9828383dc669 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:00.067107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706495b5-97d1-49df-be01-9828383dc669 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:00.067107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706495b5-97d1-49df-be01-9828383dc669 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:00.068407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 660/1320] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:00.073577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ff7e7-b7e7-426d-a55d-bc9f904eaadd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:00.074019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ff7e7-b7e7-426d-a55d-bc9f904eaadd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:00.074117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ff7e7-b7e7-426d-a55d-bc9f904eaadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:00.115298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:00.140471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9c7ff7e7-b7e7-426d-a55d-bc9f904eaadd None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:00.142267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9c7ff7e7-b7e7-426d-a55d-bc9f904eaadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:00.237013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 661/1321] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:00.276768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706495b5-97d1-49df-be01-9828383dc669 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:00.278289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-706495b5-97d1-49df-be01-9828383dc669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:00.380269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706495b5-97d1-49df-be01-9828383dc669 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:00.458566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853525d2-b152-4b80-98dc-5765b01afa14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:00.459166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853525d2-b152-4b80-98dc-5765b01afa14 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:00.459443 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853525d2-b152-4b80-98dc-5765b01afa14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:00.459713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853525d2-b152-4b80-98dc-5765b01afa14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:00.461349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-853525d2-b152-4b80-98dc-5765b01afa14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:00.468728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:00.569044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853525d2-b152-4b80-98dc-5765b01afa14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:00.570475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853525d2-b152-4b80-98dc-5765b01afa14 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:00.588231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 661/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:03.268010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ec60-cff6-445b-8811-e9ad6e682d17 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:03.268573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ec60-cff6-445b-8811-e9ad6e682d17 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:03.268573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ec60-cff6-445b-8811-e9ad6e682d17 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:03.269936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 662/1323] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:03.275307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1210d-46ee-4f2e-a934-28d295bcf944 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:03.275700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1210d-46ee-4f2e-a934-28d295bcf944 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:03.275867 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1210d-46ee-4f2e-a934-28d295bcf944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:03.346138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d8d1210d-46ee-4f2e-a934-28d295bcf944 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:03.347333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d8d1210d-46ee-4f2e-a934-28d295bcf944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:03.412954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:03.455845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 662/1324] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:03.493115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657ec60-cff6-445b-8811-e9ad6e682d17 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:03.494687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7657ec60-cff6-445b-8811-e9ad6e682d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:03.601113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657ec60-cff6-445b-8811-e9ad6e682d17 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:03.613330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:03.676152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb3cb2-b4b0-4597-9c51-4d1a230d285e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:03.676794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb3cb2-b4b0-4597-9c51-4d1a230d285e service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:03.677071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb3cb2-b4b0-4597-9c51-4d1a230d285e service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:03.677337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb3cb2-b4b0-4597-9c51-4d1a230d285e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:03.678936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-84eb3cb2-b4b0-4597-9c51-4d1a230d285e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:03.786787 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb3cb2-b4b0-4597-9c51-4d1a230d285e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:03.788109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb3cb2-b4b0-4597-9c51-4d1a230d285e service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:03.806495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 663/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:05.886168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b23c8-3ddf-430a-89f3-121c58c42243 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:05.886737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b23c8-3ddf-430a-89f3-121c58c42243 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:05.886737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b23c8-3ddf-430a-89f3-121c58c42243 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:05.888057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 663/1326] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:05.893325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7bc8b-4f11-4c41-bcbd-c154c2e814e1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:05.893762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7bc8b-4f11-4c41-bcbd-c154c2e814e1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:05.893880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7bc8b-4f11-4c41-bcbd-c154c2e814e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:05.942709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:05.960516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f0a7bc8b-4f11-4c41-bcbd-c154c2e814e1 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:05.961727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f0a7bc8b-4f11-4c41-bcbd-c154c2e814e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:06.057181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 664/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:06.093292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b23c8-3ddf-430a-89f3-121c58c42243 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:06.094829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-800b23c8-3ddf-430a-89f3-121c58c42243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:06.203552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b23c8-3ddf-430a-89f3-121c58c42243 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:06.281316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b39115-7fcf-4789-ac79-5984958ccf6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:06.282436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39115-7fcf-4789-ac79-5984958ccf6d service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:06.282707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39115-7fcf-4789-ac79-5984958ccf6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:06.283061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39115-7fcf-4789-ac79-5984958ccf6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:06.284676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-15b39115-7fcf-4789-ac79-5984958ccf6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:06.303923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:06.399884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b39115-7fcf-4789-ac79-5984958ccf6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:06.401673 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b39115-7fcf-4789-ac79-5984958ccf6d service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:06.423832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 664/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:08.514163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964fff7-1dca-41bd-9494-83e5dacca1a5 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:08.514735 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964fff7-1dca-41bd-9494-83e5dacca1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:08.514735 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964fff7-1dca-41bd-9494-83e5dacca1a5 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:08.516769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 665/1329] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:08.522048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695380ce-4d3e-4a3a-b4bd-76b7c1f9295a None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:08.522462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695380ce-4d3e-4a3a-b4bd-76b7c1f9295a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:08.522597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695380ce-4d3e-4a3a-b4bd-76b7c1f9295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:08.591579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-695380ce-4d3e-4a3a-b4bd-76b7c1f9295a None None] MFA Rules not processed for user `7641ad2083f64ed5abf305699dc5b1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:08.593030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-695380ce-4d3e-4a3a-b4bd-76b7c1f9295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:08.658854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:08.694296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 665/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:08.731711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964fff7-1dca-41bd-9494-83e5dacca1a5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:08.733284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5964fff7-1dca-41bd-9494-83e5dacca1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:08.837521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964fff7-1dca-41bd-9494-83e5dacca1a5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:08.857482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:08.912661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fe782-eec5-4a6c-8afb-efaaca4a7473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:08.913262 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fe782-eec5-4a6c-8afb-efaaca4a7473 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:08.913531 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fe782-eec5-4a6c-8afb-efaaca4a7473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:08.913788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fe782-eec5-4a6c-8afb-efaaca4a7473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:08.915373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ea5fe782-eec5-4a6c-8afb-efaaca4a7473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:09.024197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fe782-eec5-4a6c-8afb-efaaca4a7473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:09.025698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fe782-eec5-4a6c-8afb-efaaca4a7473 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:09.061148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 666/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:11.324835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104759d-0033-4dd5-9110-7c4c303bc0bb None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:11.325406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104759d-0033-4dd5-9110-7c4c303bc0bb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:11.325406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104759d-0033-4dd5-9110-7c4c303bc0bb None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:11.326744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 666/1332] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:11.332412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fefec9-f622-4bb6-a1e6-9b9c48f2e67e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:11.332824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fefec9-f622-4bb6-a1e6-9b9c48f2e67e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:11.333004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fefec9-f622-4bb6-a1e6-9b9c48f2e67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:11.394938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:11.397730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f9fefec9-f622-4bb6-a1e6-9b9c48f2e67e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:11.399469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f9fefec9-f622-4bb6-a1e6-9b9c48f2e67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:11.494635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 667/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:11.531249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104759d-0033-4dd5-9110-7c4c303bc0bb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:11.532954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a104759d-0033-4dd5-9110-7c4c303bc0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:11.635194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104759d-0033-4dd5-9110-7c4c303bc0bb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:11.707007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec297d1-ddfe-4e4a-bfc3-d39be81f42ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:11.707606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec297d1-ddfe-4e4a-bfc3-d39be81f42ed service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:11.707882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec297d1-ddfe-4e4a-bfc3-d39be81f42ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:11.708148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec297d1-ddfe-4e4a-bfc3-d39be81f42ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:11.709779 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-eec297d1-ddfe-4e4a-bfc3-d39be81f42ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:11.735707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:11.818197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec297d1-ddfe-4e4a-bfc3-d39be81f42ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:11.819636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec297d1-ddfe-4e4a-bfc3-d39be81f42ed service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:11.838664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 667/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:13.889319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4b2d3-f381-43c6-9786-ebb771bb9d6d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:13.889901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4b2d3-f381-43c6-9786-ebb771bb9d6d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:13.889901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4b2d3-f381-43c6-9786-ebb771bb9d6d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:13.891341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 668/1335] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:13.896601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e03de-475a-40ea-ab65-e5f6f7d6c878 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:13.897059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e03de-475a-40ea-ab65-e5f6f7d6c878 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:13.897171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e03de-475a-40ea-ab65-e5f6f7d6c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:13.961443 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-f91e03de-475a-40ea-ab65-e5f6f7d6c878 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:13.962635 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f91e03de-475a-40ea-ab65-e5f6f7d6c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:14.035630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:14.058688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 668/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:14.099583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4b2d3-f381-43c6-9786-ebb771bb9d6d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:14.101137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b2c4b2d3-f381-43c6-9786-ebb771bb9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:14.202672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4b2d3-f381-43c6-9786-ebb771bb9d6d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:14.230861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:14.274764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ecf78-996d-473e-9431-6c638b2c27f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:14.275360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ecf78-996d-473e-9431-6c638b2c27f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:14.275636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ecf78-996d-473e-9431-6c638b2c27f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:14.275904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ecf78-996d-473e-9431-6c638b2c27f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:14.277531 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1c7ecf78-996d-473e-9431-6c638b2c27f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:14.385797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ecf78-996d-473e-9431-6c638b2c27f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:14.387225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ecf78-996d-473e-9431-6c638b2c27f5 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:14.406141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 669/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:17.050254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eea7bb-1e03-438c-8c71-cadf3d9d2d64 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:17.050823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eea7bb-1e03-438c-8c71-cadf3d9d2d64 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:17.050823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eea7bb-1e03-438c-8c71-cadf3d9d2d64 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:17.052145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 669/1338] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:17.057269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e182a-d417-46cf-83d9-253a69dae9f9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:17.057685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e182a-d417-46cf-83d9-253a69dae9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:17.057848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e182a-d417-46cf-83d9-253a69dae9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:17.122932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a96e182a-d417-46cf-83d9-253a69dae9f9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:17.124133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a96e182a-d417-46cf-83d9-253a69dae9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:17.132333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:17.220417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 670/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:17.256421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eea7bb-1e03-438c-8c71-cadf3d9d2d64 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:17.258062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-58eea7bb-1e03-438c-8c71-cadf3d9d2d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:17.361938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eea7bb-1e03-438c-8c71-cadf3d9d2d64 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:17.434474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48528fb-1212-4acd-891a-52576aca3859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:17.435056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48528fb-1212-4acd-891a-52576aca3859 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:17.435332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48528fb-1212-4acd-891a-52576aca3859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:17.435597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48528fb-1212-4acd-891a-52576aca3859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:17.437201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e48528fb-1212-4acd-891a-52576aca3859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:17.472639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:17.543795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48528fb-1212-4acd-891a-52576aca3859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:17.545517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48528fb-1212-4acd-891a-52576aca3859 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:17.564059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 670/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:21.671812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d4e92-6144-428b-a995-abe9b9c5d7cb None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:21.672345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d4e92-6144-428b-a995-abe9b9c5d7cb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:21.672345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d4e92-6144-428b-a995-abe9b9c5d7cb None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:21.673669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 671/1341] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:14:21.679087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658d19-7336-41f7-a099-888076e5024e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:21.679514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658d19-7336-41f7-a099-888076e5024e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:21.679604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658d19-7336-41f7-a099-888076e5024e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:21.747210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-b2658d19-7336-41f7-a099-888076e5024e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:21.748410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b2658d19-7336-41f7-a099-888076e5024e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:21.834906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:21.847275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 671/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:21.886170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d4e92-6144-428b-a995-abe9b9c5d7cb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:21.887739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3d9d4e92-6144-428b-a995-abe9b9c5d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:21.990919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d4e92-6144-428b-a995-abe9b9c5d7cb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:22.029005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:22.065396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92326bbd-cb5d-493c-bb7a-7e9c33abd739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:22.066006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92326bbd-cb5d-493c-bb7a-7e9c33abd739 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:22.066282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92326bbd-cb5d-493c-bb7a-7e9c33abd739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:22.066554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92326bbd-cb5d-493c-bb7a-7e9c33abd739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:22.068137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-92326bbd-cb5d-493c-bb7a-7e9c33abd739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:22.179935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92326bbd-cb5d-493c-bb7a-7e9c33abd739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:22.181394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92326bbd-cb5d-493c-bb7a-7e9c33abd739 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:22.200830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 672/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:24.824161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049722-362c-46e6-8e56-928da17accad None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:24.824733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049722-362c-46e6-8e56-928da17accad None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:24.824733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049722-362c-46e6-8e56-928da17accad None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:24.826019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 672/1344] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:24.832146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42786e6-1bd3-42e1-92cd-db9a7ffca73b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:24.832698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42786e6-1bd3-42e1-92cd-db9a7ffca73b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:24.832698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42786e6-1bd3-42e1-92cd-db9a7ffca73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:24.906095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a42786e6-1bd3-42e1-92cd-db9a7ffca73b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:24.907889 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a42786e6-1bd3-42e1-92cd-db9a7ffca73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:24.927632 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:25.010691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 673/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:25.049960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3049722-362c-46e6-8e56-928da17accad None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:25.051619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c3049722-362c-46e6-8e56-928da17accad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:25.159578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3049722-362c-46e6-8e56-928da17accad None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:25.235640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b3de0-3a6e-45d1-965a-54c82f508f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:25.236265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b3de0-3a6e-45d1-965a-54c82f508f5d service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:25.236527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b3de0-3a6e-45d1-965a-54c82f508f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:25.236824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b3de0-3a6e-45d1-965a-54c82f508f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:25.238459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-383b3de0-3a6e-45d1-965a-54c82f508f5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:25.281541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:25.350530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b3de0-3a6e-45d1-965a-54c82f508f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:25.351979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b3de0-3a6e-45d1-965a-54c82f508f5d service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:25.371170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 673/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:29.347971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e48b05-04cf-4c54-b8e6-7a95c84d817e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:29.348486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e48b05-04cf-4c54-b8e6-7a95c84d817e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:29.348486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e48b05-04cf-4c54-b8e6-7a95c84d817e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:29.350186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 674/1347] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:29.355559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4e174-dc50-4f71-b1c2-5e80eb27093c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:29.356006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4e174-dc50-4f71-b1c2-5e80eb27093c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:29.356099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4e174-dc50-4f71-b1c2-5e80eb27093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:29.426512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-e3e4e174-dc50-4f71-b1c2-5e80eb27093c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:29.427724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e3e4e174-dc50-4f71-b1c2-5e80eb27093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:29.522609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:29.527439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 674/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:29.564841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e48b05-04cf-4c54-b8e6-7a95c84d817e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:29.566450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-55e48b05-04cf-4c54-b8e6-7a95c84d817e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:29.678045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e48b05-04cf-4c54-b8e6-7a95c84d817e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:29.742772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:29.773859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cf031-36c4-4ae7-a84f-3ff009f84a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:29.774428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cf031-36c4-4ae7-a84f-3ff009f84a90 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:29.774705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cf031-36c4-4ae7-a84f-3ff009f84a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:29.774975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cf031-36c4-4ae7-a84f-3ff009f84a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:29.776634 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-315cf031-36c4-4ae7-a84f-3ff009f84a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:29.893358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cf031-36c4-4ae7-a84f-3ff009f84a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:29.894809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cf031-36c4-4ae7-a84f-3ff009f84a90 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:29.913686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 675/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:34.846538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562eb4-f378-4a03-ab88-c74de2785cb4 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:34.847522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562eb4-f378-4a03-ab88-c74de2785cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:34.848260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562eb4-f378-4a03-ab88-c74de2785cb4 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:34.850341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 675/1350] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:14:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:34.860433 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b4805-4bae-4b35-b01e-d4eeaafc3109 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:34.860433 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b4805-4bae-4b35-b01e-d4eeaafc3109 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:34.860433 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b4805-4bae-4b35-b01e-d4eeaafc3109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:35.008895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-cc7b4805-4bae-4b35-b01e-d4eeaafc3109 None None] MFA Rules not processed for user `c7f2e22ace8648919104c910c74c1711`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:35.010178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cc7b4805-4bae-4b35-b01e-d4eeaafc3109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:35.034273 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:35.148291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 676/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:14:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:39.306202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228894-1c53-4687-a8df-9ede24a01a66 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:39.307125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228894-1c53-4687-a8df-9ede24a01a66 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:39.307421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228894-1c53-4687-a8df-9ede24a01a66 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:39.308814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 676/1352] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:39.315440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577da4c3-f738-4612-8736-8d2c40119bef None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:39.315964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577da4c3-f738-4612-8736-8d2c40119bef None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:39.316047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577da4c3-f738-4612-8736-8d2c40119bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:39.402962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-577da4c3-f738-4612-8736-8d2c40119bef None None] MFA Rules not processed for user `c7f2e22ace8648919104c910c74c1711`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:39.404160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-577da4c3-f738-4612-8736-8d2c40119bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:39.488354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:39.531939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 677/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:40.896447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7d267-2b55-41b8-9567-60edc00faf60 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:40.897016 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7d267-2b55-41b8-9567-60edc00faf60 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:40.897016 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7d267-2b55-41b8-9567-60edc00faf60 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:40.898369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 677/1354] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:40.903398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0558-89c6-47f3-8940-79068bf2ce71 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:40.903786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0558-89c6-47f3-8940-79068bf2ce71 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:40.903967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0558-89c6-47f3-8940-79068bf2ce71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:40.980350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0d5a0558-89c6-47f3-8940-79068bf2ce71 None None] MFA Rules not processed for user `c7f2e22ace8648919104c910c74c1711`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:40.981575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0d5a0558-89c6-47f3-8940-79068bf2ce71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:41.088976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 678/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:44.433040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1613-2972-4fce-a896-539e68c7f6a3 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:44.433578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1613-2972-4fce-a896-539e68c7f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:44.433578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1613-2972-4fce-a896-539e68c7f6a3 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:44.435150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 678/1356] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:44.443004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e111c-52ad-4ee2-8fc1-814006a80bf2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:44.443004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e111c-52ad-4ee2-8fc1-814006a80bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:44.443004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e111c-52ad-4ee2-8fc1-814006a80bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:44.491707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:44.528589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fb9e111c-52ad-4ee2-8fc1-814006a80bf2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:44.530415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fb9e111c-52ad-4ee2-8fc1-814006a80bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:44.656763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 679/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:44.706246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feecb4c-675c-421a-9f77-62c012a93d19 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:44.706597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feecb4c-675c-421a-9f77-62c012a93d19 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:44.706941 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feecb4c-675c-421a-9f77-62c012a93d19 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:44.708373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 679/1358] 10.222.0.25 () {54 vars in 962 bytes} [Tue Aug 9 12:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:44.714939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc29fa-fa93-45fa-8807-5c5e18d4b006 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:44.715332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc29fa-fa93-45fa-8807-5c5e18d4b006 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:44.715674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc29fa-fa93-45fa-8807-5c5e18d4b006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:44.798773 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-63cc29fa-fa93-45fa-8807-5c5e18d4b006 None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:44.800079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-63cc29fa-fa93-45fa-8807-5c5e18d4b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:44.854945 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:44.928716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 680/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Aug 9 12:14:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:14:44.936303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feecb4c-675c-421a-9f77-62c012a93d19 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:44.938180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5feecb4c-675c-421a-9f77-62c012a93d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:45.100762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feecb4c-675c-421a-9f77-62c012a93d19 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:45.181076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:45.226938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073ad0f-553a-49a0-ae1b-a92f58520240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:45.227690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073ad0f-553a-49a0-ae1b-a92f58520240 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:45.228132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073ad0f-553a-49a0-ae1b-a92f58520240 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:45.228405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073ad0f-553a-49a0-ae1b-a92f58520240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:45.230102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-6073ad0f-553a-49a0-ae1b-a92f58520240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:45.332132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073ad0f-553a-49a0-ae1b-a92f58520240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:45.333827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073ad0f-553a-49a0-ae1b-a92f58520240 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:45.355348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 680/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:47.609932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58319acd-7de5-492b-ab1d-3af18d07f3d0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:47.610377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58319acd-7de5-492b-ab1d-3af18d07f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:47.610585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58319acd-7de5-492b-ab1d-3af18d07f3d0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:47.612991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 681/1361] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:47.617864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61298359-2544-4822-8c80-c39099383ab4 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:47.618284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61298359-2544-4822-8c80-c39099383ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:47.618452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61298359-2544-4822-8c80-c39099383ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:47.690352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-61298359-2544-4822-8c80-c39099383ab4 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:47.691544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-61298359-2544-4822-8c80-c39099383ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:47.732357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:47.797023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 681/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:47.845978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58319acd-7de5-492b-ab1d-3af18d07f3d0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:47.847595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-58319acd-7de5-492b-ab1d-3af18d07f3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:48.019989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58319acd-7de5-492b-ab1d-3af18d07f3d0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:48.030793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:48.150353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8a7d7-8974-4dae-88ad-ad713f5f9eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:48.150969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8a7d7-8974-4dae-88ad-ad713f5f9eac service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:48.151291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8a7d7-8974-4dae-88ad-ad713f5f9eac service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:48.151291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8a7d7-8974-4dae-88ad-ad713f5f9eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:48.153038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-19b8a7d7-8974-4dae-88ad-ad713f5f9eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:48.252230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8a7d7-8974-4dae-88ad-ad713f5f9eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:48.253864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8a7d7-8974-4dae-88ad-ad713f5f9eac service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:48.273510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 682/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:50.737575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bca9e-20d6-46b1-9a9c-ba9bd337e301 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:50.738125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bca9e-20d6-46b1-9a9c-ba9bd337e301 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:50.738125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bca9e-20d6-46b1-9a9c-ba9bd337e301 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:50.739372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 682/1364] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:50.744726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88b25-4ef6-49f6-b3d0-31255b6959a9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:50.745144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88b25-4ef6-49f6-b3d0-31255b6959a9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:50.745447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88b25-4ef6-49f6-b3d0-31255b6959a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:50.763641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:50.835950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a3e88b25-4ef6-49f6-b3d0-31255b6959a9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:50.837256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a3e88b25-4ef6-49f6-b3d0-31255b6959a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:50.952564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 683/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:51.000531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97d550-ecf6-44d5-8c4c-bc3c948325a4 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:51.000882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97d550-ecf6-44d5-8c4c-bc3c948325a4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:51.001069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97d550-ecf6-44d5-8c4c-bc3c948325a4 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:51.002657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 683/1366] 10.222.0.25 () {54 vars in 962 bytes} [Tue Aug 9 12:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:51.008066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facc06c-21f3-43b6-84e5-8b2c9f6c05fc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:51.008350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facc06c-21f3-43b6-84e5-8b2c9f6c05fc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:51.008618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facc06c-21f3-43b6-84e5-8b2c9f6c05fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:51.090034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5facc06c-21f3-43b6-84e5-8b2c9f6c05fc None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:51.091378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5facc06c-21f3-43b6-84e5-8b2c9f6c05fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:51.132208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:51.222567 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 684/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Aug 9 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:51.230664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97d550-ecf6-44d5-8c4c-bc3c948325a4 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:51.232284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8a97d550-ecf6-44d5-8c4c-bc3c948325a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:51.403510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97d550-ecf6-44d5-8c4c-bc3c948325a4 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:51.431442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:51.532072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8999a9-a5a3-40c5-bcfd-e91649d8808f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:51.532891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8999a9-a5a3-40c5-bcfd-e91649d8808f service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:51.533330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8999a9-a5a3-40c5-bcfd-e91649d8808f service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:51.533700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8999a9-a5a3-40c5-bcfd-e91649d8808f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:51.535407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5d8999a9-a5a3-40c5-bcfd-e91649d8808f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:51.634846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8999a9-a5a3-40c5-bcfd-e91649d8808f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:51.636652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8999a9-a5a3-40c5-bcfd-e91649d8808f service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:51.655667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 684/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:14:52.704807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080afe12-c1ee-4d6a-b9f3-ada0f80288cc None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:52.705323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080afe12-c1ee-4d6a-b9f3-ada0f80288cc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:52.705323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080afe12-c1ee-4d6a-b9f3-ada0f80288cc None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:52.706778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 685/1369] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:52.711925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee4ca-eeb6-47bc-9a75-d63bb94dc851 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:52.712361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee4ca-eeb6-47bc-9a75-d63bb94dc851 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:52.712441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee4ca-eeb6-47bc-9a75-d63bb94dc851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:52.745568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:52.784217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c7dee4ca-eeb6-47bc-9a75-d63bb94dc851 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:52.785451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c7dee4ca-eeb6-47bc-9a75-d63bb94dc851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:52.892981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 685/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:53.241466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00e761-8273-446f-a66e-d5601b2c0b28 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:53.241466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00e761-8273-446f-a66e-d5601b2c0b28 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:53.241466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00e761-8273-446f-a66e-d5601b2c0b28 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:53.244278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 686/1371] 10.222.0.25 () {54 vars in 964 bytes} [Tue Aug 9 12:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:53.247498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725766a2-dce1-42a5-8cb7-a309e2f9adb2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:53.247833 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725766a2-dce1-42a5-8cb7-a309e2f9adb2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:53.248724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725766a2-dce1-42a5-8cb7-a309e2f9adb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:53.331268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-725766a2-dce1-42a5-8cb7-a309e2f9adb2 None None] MFA Rules not processed for user `f0b215bfb43742678bd5a728973dbc46`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:53.332464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-725766a2-dce1-42a5-8cb7-a309e2f9adb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:53.380364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:53.413761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 686/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Aug 9 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:14:53.422300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00e761-8273-446f-a66e-d5601b2c0b28 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:53.423805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ac00e761-8273-446f-a66e-d5601b2c0b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:53.532892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00e761-8273-446f-a66e-d5601b2c0b28 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:53.573849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:53.612016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d938eb3-24ae-4a91-a66e-26d826064a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:53.612749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938eb3-24ae-4a91-a66e-26d826064a50 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:53.613092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938eb3-24ae-4a91-a66e-26d826064a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:53.613644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938eb3-24ae-4a91-a66e-26d826064a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:53.615485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5d938eb3-24ae-4a91-a66e-26d826064a50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:53.738482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938eb3-24ae-4a91-a66e-26d826064a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:53.739918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938eb3-24ae-4a91-a66e-26d826064a50 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:53.760237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 687/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:53.773393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f5592-9884-4c7a-9752-6618bf187455 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:53.773836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f5592-9884-4c7a-9752-6618bf187455 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:53.774268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f5592-9884-4c7a-9752-6618bf187455 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:53.776423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 687/1374] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:53.782381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6489fc7-9ec0-4da4-adc8-1d434eef0ea5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:53.782784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6489fc7-9ec0-4da4-adc8-1d434eef0ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:53.783067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6489fc7-9ec0-4da4-adc8-1d434eef0ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:53.862351 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b6489fc7-9ec0-4da4-adc8-1d434eef0ea5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:53.863845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b6489fc7-9ec0-4da4-adc8-1d434eef0ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:53.886027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:53.984923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 688/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:54.032221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f5592-9884-4c7a-9752-6618bf187455 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:54.033796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-421f5592-9884-4c7a-9752-6618bf187455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:54.196559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f5592-9884-4c7a-9752-6618bf187455 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:54.248169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:54.311096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951cc76-1858-4e1e-86d9-8472510fdbd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:54.311646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951cc76-1858-4e1e-86d9-8472510fdbd4 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:54.311921 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951cc76-1858-4e1e-86d9-8472510fdbd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:54.312189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951cc76-1858-4e1e-86d9-8472510fdbd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:54.313813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f951cc76-1858-4e1e-86d9-8472510fdbd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:54.404592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951cc76-1858-4e1e-86d9-8472510fdbd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:54.406250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951cc76-1858-4e1e-86d9-8472510fdbd4 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:54.427883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 688/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:56.484690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600c679-3146-441b-96a5-db43da026972 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:56.485570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600c679-3146-441b-96a5-db43da026972 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:56.485847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600c679-3146-441b-96a5-db43da026972 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:56.487217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 689/1377] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:56.492569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb85eee-f0ba-4fdd-8ef1-6d2c5925d096 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:56.493093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb85eee-f0ba-4fdd-8ef1-6d2c5925d096 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:56.493199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb85eee-f0ba-4fdd-8ef1-6d2c5925d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:56.559439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-bcb85eee-f0ba-4fdd-8ef1-6d2c5925d096 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:56.561325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bcb85eee-f0ba-4fdd-8ef1-6d2c5925d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:56.567863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:56.666025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 689/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:14:56.720218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600c679-3146-441b-96a5-db43da026972 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:56.721783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e600c679-3146-441b-96a5-db43da026972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:56.882267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600c679-3146-441b-96a5-db43da026972 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:56.886253 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:56.995451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ec817-fd96-4fb2-9c69-6ca14194cc40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:56.995947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec817-fd96-4fb2-9c69-6ca14194cc40 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:56.996215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec817-fd96-4fb2-9c69-6ca14194cc40 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:56.996475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec817-fd96-4fb2-9c69-6ca14194cc40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:56.998719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-516ec817-fd96-4fb2-9c69-6ca14194cc40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:57.092371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ec817-fd96-4fb2-9c69-6ca14194cc40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:57.094048 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ec817-fd96-4fb2-9c69-6ca14194cc40 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:57.116228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 690/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:59.207579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b589-135c-4301-b12d-0408c1da62eb None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:59.208110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b589-135c-4301-b12d-0408c1da62eb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:59.208110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b589-135c-4301-b12d-0408c1da62eb None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:59.209468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 690/1380] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:59.214750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9b89-9d49-4f10-95b3-936c3dd7cb2c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:59.215185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9b89-9d49-4f10-95b3-936c3dd7cb2c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:59.215290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9b89-9d49-4f10-95b3-936c3dd7cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:59.227332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:59.289783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-336e9b89-9d49-4f10-95b3-936c3dd7cb2c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:59.291064 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-336e9b89-9d49-4f10-95b3-936c3dd7cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:59.408819 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 691/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:59.448651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72b589-135c-4301-b12d-0408c1da62eb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:59.450197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ef72b589-135c-4301-b12d-0408c1da62eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:59.610600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:59.622064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72b589-135c-4301-b12d-0408c1da62eb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:59.741666 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433f87a-1949-4461-8355-4b363f0c4378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:59.742364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f87a-1949-4461-8355-4b363f0c4378 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:59.742811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f87a-1949-4461-8355-4b363f0c4378 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:59.743135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f87a-1949-4461-8355-4b363f0c4378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:59.744822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4433f87a-1949-4461-8355-4b363f0c4378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:59.843528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433f87a-1949-4461-8355-4b363f0c4378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:59.845350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433f87a-1949-4461-8355-4b363f0c4378 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:59.857273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:59.867302 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 691/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:02.120327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975ade0-2e3d-473b-ae5f-74d85dd4ddaf None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:02.120900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975ade0-2e3d-473b-ae5f-74d85dd4ddaf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:02.120900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975ade0-2e3d-473b-ae5f-74d85dd4ddaf None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:02.122354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 692/1383] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:02.127983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf8529-d880-455f-b5b9-e5a462fc4b18 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:02.128410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf8529-d880-455f-b5b9-e5a462fc4b18 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:02.128604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf8529-d880-455f-b5b9-e5a462fc4b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:02.199979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9ecf8529-d880-455f-b5b9-e5a462fc4b18 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:02.201936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9ecf8529-d880-455f-b5b9-e5a462fc4b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:02.309621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 692/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:02.355268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975ade0-2e3d-473b-ae5f-74d85dd4ddaf None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:02.357085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f975ade0-2e3d-473b-ae5f-74d85dd4ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:02.447783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:02.514012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975ade0-2e3d-473b-ae5f-74d85dd4ddaf None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:02.639892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7617204-a2bc-4674-a6c7-959499575789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:02.640501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7617204-a2bc-4674-a6c7-959499575789 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:02.640808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7617204-a2bc-4674-a6c7-959499575789 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:02.641075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7617204-a2bc-4674-a6c7-959499575789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:02.642675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d7617204-a2bc-4674-a6c7-959499575789 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:02.693834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:02.734686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7617204-a2bc-4674-a6c7-959499575789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:02.736317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7617204-a2bc-4674-a6c7-959499575789 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:02.754921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 693/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:05.286450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2f2d7-0a83-4947-b377-ee491fd48ff2 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:05.287005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2f2d7-0a83-4947-b377-ee491fd48ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:05.287005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2f2d7-0a83-4947-b377-ee491fd48ff2 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:05.288437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 693/1386] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:05.294915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ff431-3f61-4fef-bb54-0eb6c372f43f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:05.295363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ff431-3f61-4fef-bb54-0eb6c372f43f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:05.295458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ff431-3f61-4fef-bb54-0eb6c372f43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:05.369717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c74ff431-3f61-4fef-bb54-0eb6c372f43f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:05.370918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c74ff431-3f61-4fef-bb54-0eb6c372f43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:05.479018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 694/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:05.532379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2f2d7-0a83-4947-b377-ee491fd48ff2 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:05.534119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-03d2f2d7-0a83-4947-b377-ee491fd48ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:05.627096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:05.699309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2f2d7-0a83-4947-b377-ee491fd48ff2 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:05.819445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4547ab-38a2-4f2f-be07-a129d2e05a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:05.819875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4547ab-38a2-4f2f-be07-a129d2e05a3a service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:05.820165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4547ab-38a2-4f2f-be07-a129d2e05a3a service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:05.820442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4547ab-38a2-4f2f-be07-a129d2e05a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:05.822133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5f4547ab-38a2-4f2f-be07-a129d2e05a3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:05.865262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:05.918649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4547ab-38a2-4f2f-be07-a129d2e05a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:05.920846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4547ab-38a2-4f2f-be07-a129d2e05a3a service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:05.939628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 694/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:07.997500 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f9885-47f5-4226-947a-7067e80ec82a None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:07.998069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f9885-47f5-4226-947a-7067e80ec82a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:07.998069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f9885-47f5-4226-947a-7067e80ec82a None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:07.999434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 695/1389] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:08.004725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913ee2-b8d9-4e50-816d-31b8da7c833d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:08.005140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913ee2-b8d9-4e50-816d-31b8da7c833d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:08.005272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913ee2-b8d9-4e50-816d-31b8da7c833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:08.071373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-47913ee2-b8d9-4e50-816d-31b8da7c833d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:08.072564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-47913ee2-b8d9-4e50-816d-31b8da7c833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:08.172538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 695/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:08.216469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f9885-47f5-4226-947a-7067e80ec82a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:08.218037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c48f9885-47f5-4226-947a-7067e80ec82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:08.249860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:08.367574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f9885-47f5-4226-947a-7067e80ec82a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:08.472713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:08.485272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae8386-e35a-42e8-96d9-0b77cdc4b830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:08.485877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8386-e35a-42e8-96d9-0b77cdc4b830 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:08.486153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8386-e35a-42e8-96d9-0b77cdc4b830 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:08.486426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8386-e35a-42e8-96d9-0b77cdc4b830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:08.488059 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c2ae8386-e35a-42e8-96d9-0b77cdc4b830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:08.601925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae8386-e35a-42e8-96d9-0b77cdc4b830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:08.603452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae8386-e35a-42e8-96d9-0b77cdc4b830 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:08.622726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 696/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:08.820116 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706ed0-6a6e-499e-8ce1-6fa6b1f1cc56 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:08.820379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706ed0-6a6e-499e-8ce1-6fa6b1f1cc56 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:08.820681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706ed0-6a6e-499e-8ce1-6fa6b1f1cc56 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:08.822066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 696/1392] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:08.828373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52f9f3-5215-419c-8ef9-954331fdf51d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:08.828665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52f9f3-5215-419c-8ef9-954331fdf51d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:08.828939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52f9f3-5215-419c-8ef9-954331fdf51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:08.895553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-da52f9f3-5215-419c-8ef9-954331fdf51d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:08.896766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-da52f9f3-5215-419c-8ef9-954331fdf51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:08.956925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:08.996275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 697/1393] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:09.052113 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86063efa-9fbd-43c9-a4ca-40236a8e2e86 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:09.052594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86063efa-9fbd-43c9-a4ca-40236a8e2e86 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:09.052721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86063efa-9fbd-43c9-a4ca-40236a8e2e86 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:09.054015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 697/1394] 10.222.0.25 () {54 vars in 967 bytes} [Tue Aug 9 12:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:09.058918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cc1e9-85f5-4f4a-9890-57100ac972a4 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:09.059925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cc1e9-85f5-4f4a-9890-57100ac972a4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:09.060195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cc1e9-85f5-4f4a-9890-57100ac972a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:09.137284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-500cc1e9-85f5-4f4a-9890-57100ac972a4 None None] MFA Rules not processed for user `79efccae1afa46e78c25f617bf2dd9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:09.138704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-500cc1e9-85f5-4f4a-9890-57100ac972a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:09.218373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 698/1395] 10.222.0.25 () {58 vars in 1064 bytes} [Tue Aug 9 12:15:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:09.226249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86063efa-9fbd-43c9-a4ca-40236a8e2e86 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:09.227767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-86063efa-9fbd-43c9-a4ca-40236a8e2e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:09.242197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:09.334409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86063efa-9fbd-43c9-a4ca-40236a8e2e86 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:09.408782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbaac05-311c-426b-bbc1-b41affb4fc29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79efccae1afa46e78c25f617bf2dd9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:09.409395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaac05-311c-426b-bbc1-b41affb4fc29 service glance] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:09.409669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaac05-311c-426b-bbc1-b41affb4fc29 service glance] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:09.409938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaac05-311c-426b-bbc1-b41affb4fc29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:09.411529 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ebbaac05-311c-426b-bbc1-b41affb4fc29 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:09.480697 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:09.521294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbaac05-311c-426b-bbc1-b41affb4fc29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:09.522742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbaac05-311c-426b-bbc1-b41affb4fc29 service glance] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:09.541040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 698/1396] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:10.273417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d3755-253a-4ca1-989e-88812c6a05a3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:10.273899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d3755-253a-4ca1-989e-88812c6a05a3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:10.274015 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d3755-253a-4ca1-989e-88812c6a05a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:10.343217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7d0d3755-253a-4ca1-989e-88812c6a05a3 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:10.344404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7d0d3755-253a-4ca1-989e-88812c6a05a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:10.352699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:10.434783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 699/1397] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:15:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:15:10.476577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee663a55-beaf-4f7a-89e8-7d32df03a71b None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:10.477086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee663a55-beaf-4f7a-89e8-7d32df03a71b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:10.477179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee663a55-beaf-4f7a-89e8-7d32df03a71b None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:10.478579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 699/1398] 10.222.0.25 () {54 vars in 943 bytes} [Tue Aug 9 12:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:10.485240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897cf5-0d3e-42ae-a547-b613b2ef518e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:10.485526 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897cf5-0d3e-42ae-a547-b613b2ef518e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:10.485794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897cf5-0d3e-42ae-a547-b613b2ef518e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:10.562470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-65897cf5-0d3e-42ae-a547-b613b2ef518e None None] MFA Rules not processed for user `20f9b96629544596a8d9b81cce57af21`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:10.563657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-65897cf5-0d3e-42ae-a547-b613b2ef518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:10.655107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:10.678631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 700/1399] 10.222.0.25 () {58 vars in 1040 bytes} [Tue Aug 9 12:15:10 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:15:10.679863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ce1d-8a43-4622-94b5-906691730a52 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:10.680156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ce1d-8a43-4622-94b5-906691730a52 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:10.680472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ce1d-8a43-4622-94b5-906691730a52 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:10.681785 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 700/1400] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:10.687586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e9b5-fa8a-47d3-88fa-7076efd4510e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:10.687864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e9b5-fa8a-47d3-88fa-7076efd4510e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:10.688251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e9b5-fa8a-47d3-88fa-7076efd4510e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:10.689184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4ce1d-8a43-4622-94b5-906691730a52 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:10.690855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-6ae4ce1d-8a43-4622-94b5-906691730a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:10.754204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f7d5e9b5-fa8a-47d3-88fa-7076efd4510e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:10.755407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f7d5e9b5-fa8a-47d3-88fa-7076efd4510e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:10.835806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4ce1d-8a43-4622-94b5-906691730a52 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:10.858093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 701/1401] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:15:10.874592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:10.903436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5e9b5-fa8a-47d3-88fa-7076efd4510e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:10.904755 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f7d5e9b5-fa8a-47d3-88fa-7076efd4510e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:10.943812 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438d9b2-fe0b-406a-b05d-1a38c71750b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:10.944341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438d9b2-fe0b-406a-b05d-1a38c71750b7 service swift] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:10.944613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438d9b2-fe0b-406a-b05d-1a38c71750b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:10.944910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438d9b2-fe0b-406a-b05d-1a38c71750b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:10.946540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d438d9b2-fe0b-406a-b05d-1a38c71750b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:10.968524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:11.020241 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5e9b5-fa8a-47d3-88fa-7076efd4510e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:11.029095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438d9b2-fe0b-406a-b05d-1a38c71750b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:11.030703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438d9b2-fe0b-406a-b05d-1a38c71750b7 service swift] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:11.038683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 701/1402] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:15:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 12:15:11.156943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26692403-98bc-4cd5-a59f-32eb80b684c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:11.157552 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26692403-98bc-4cd5-a59f-32eb80b684c8 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:11.157852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26692403-98bc-4cd5-a59f-32eb80b684c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:11.158224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26692403-98bc-4cd5-a59f-32eb80b684c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:11.166797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-26692403-98bc-4cd5-a59f-32eb80b684c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:11.232516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:11.266177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26692403-98bc-4cd5-a59f-32eb80b684c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:11.268373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26692403-98bc-4cd5-a59f-32eb80b684c8 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:11.287582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 702/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:15:13.377690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17168e-46af-4295-a505-d9eceabb778d None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:13.378260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17168e-46af-4295-a505-d9eceabb778d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:13.378260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17168e-46af-4295-a505-d9eceabb778d None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:13.380136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 702/1404] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:13.385288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa753e3-7195-4ecb-9558-54439645068b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:13.385745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa753e3-7195-4ecb-9558-54439645068b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:13.385844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa753e3-7195-4ecb-9558-54439645068b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:13.461138 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7fa753e3-7195-4ecb-9558-54439645068b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:13.462378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7fa753e3-7195-4ecb-9558-54439645068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:13.593969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 703/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:13.648426 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17168e-46af-4295-a505-d9eceabb778d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:13.650023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-cf17168e-46af-4295-a505-d9eceabb778d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:13.779230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:13.864730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17168e-46af-4295-a505-d9eceabb778d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:13.986683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c626d-b9cf-4eb0-89a6-f9a3ca1b7dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:13.987412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c626d-b9cf-4eb0-89a6-f9a3ca1b7dcd service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:13.987756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c626d-b9cf-4eb0-89a6-f9a3ca1b7dcd service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:13.988097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c626d-b9cf-4eb0-89a6-f9a3ca1b7dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:13.989800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-808c626d-b9cf-4eb0-89a6-f9a3ca1b7dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:14.022405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:14.090809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c626d-b9cf-4eb0-89a6-f9a3ca1b7dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:14.092673 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c626d-b9cf-4eb0-89a6-f9a3ca1b7dcd service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:14.113195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 703/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:16.213347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814a361-f448-42e0-a937-e83ccfa049f6 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:16.214323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814a361-f448-42e0-a937-e83ccfa049f6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:16.214832 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814a361-f448-42e0-a937-e83ccfa049f6 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:16.217414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 704/1407] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:15:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:16.222733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c2bbf-cde5-458e-acf1-0a5216b0156e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:16.223190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c2bbf-cde5-458e-acf1-0a5216b0156e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:16.223295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c2bbf-cde5-458e-acf1-0a5216b0156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:16.295323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d21c2bbf-cde5-458e-acf1-0a5216b0156e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:16.296535 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d21c2bbf-cde5-458e-acf1-0a5216b0156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:16.408821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 704/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:16.466684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814a361-f448-42e0-a937-e83ccfa049f6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:16.468522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1814a361-f448-42e0-a937-e83ccfa049f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:16.514073 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:16.643635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814a361-f448-42e0-a937-e83ccfa049f6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:16.761940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:16.768587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f02f53-fdd9-4036-a93f-cdd2d0b9d9fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:16.769215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02f53-fdd9-4036-a93f-cdd2d0b9d9fd service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:16.769484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02f53-fdd9-4036-a93f-cdd2d0b9d9fd service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:16.769765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f02f53-fdd9-4036-a93f-cdd2d0b9d9fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:16.771340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-74f02f53-fdd9-4036-a93f-cdd2d0b9d9fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:16.876173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f02f53-fdd9-4036-a93f-cdd2d0b9d9fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:16.877837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f02f53-fdd9-4036-a93f-cdd2d0b9d9fd service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:16.899328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 705/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:26.406833 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:26.896461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=47 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:33.301000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a8dba-2e90-4935-8d92-04164f449098 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:33.301542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a8dba-2e90-4935-8d92-04164f449098 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:33.301542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a8dba-2e90-4935-8d92-04164f449098 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:33.302922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 705/1410] 10.222.0.25 () {54 vars in 918 bytes} [Tue Aug 9 12:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:33.308547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164012e-b398-4626-a041-9e97ee1e9c2c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:33.309020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164012e-b398-4626-a041-9e97ee1e9c2c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:33.309127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164012e-b398-4626-a041-9e97ee1e9c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:33.383234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7164012e-b398-4626-a041-9e97ee1e9c2c None None] MFA Rules not processed for user `c7f2e22ace8648919104c910c74c1711`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:33.384843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7164012e-b398-4626-a041-9e97ee1e9c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:33.491319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 706/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Aug 9 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:33.506388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d9ab6-d504-4b9e-b671-1a827eb74a10 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:33.506751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d9ab6-d504-4b9e-b671-1a827eb74a10 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:33.507027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d9ab6-d504-4b9e-b671-1a827eb74a10 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:33.508372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 706/1412] 10.222.0.25 () {54 vars in 918 bytes} [Tue Aug 9 12:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:33.513545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852757f-d84a-4ebb-9e87-f9a0dcd18420 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:33.513831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852757f-d84a-4ebb-9e87-f9a0dcd18420 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:33.514103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852757f-d84a-4ebb-9e87-f9a0dcd18420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:33.585826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:33.589039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4852757f-d84a-4ebb-9e87-f9a0dcd18420 None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:33.590757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4852757f-d84a-4ebb-9e87-f9a0dcd18420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:33.705390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 707/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Aug 9 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:15:36.157997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15d190-64c6-4bf7-8cee-cef35c1cd4fd None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:36.158555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15d190-64c6-4bf7-8cee-cef35c1cd4fd None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:36.158555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15d190-64c6-4bf7-8cee-cef35c1cd4fd None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:36.159911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:36.165423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855579a-79d4-47e4-a110-4dd67edc7297 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:36.165820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855579a-79d4-47e4-a110-4dd67edc7297 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:36.165976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855579a-79d4-47e4-a110-4dd67edc7297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:36.232742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3855579a-79d4-47e4-a110-4dd67edc7297 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:36.233940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3855579a-79d4-47e4-a110-4dd67edc7297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:36.287996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:36.330213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:36.372911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15d190-64c6-4bf7-8cee-cef35c1cd4fd None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:36.374423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-da15d190-64c6-4bf7-8cee-cef35c1cd4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:36.521522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15d190-64c6-4bf7-8cee-cef35c1cd4fd None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:36.594714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:36.634376 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1c1cd-b851-4caa-8f67-d54f0067440b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:36.634981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1c1cd-b851-4caa-8f67-d54f0067440b service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:36.635259 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1c1cd-b851-4caa-8f67-d54f0067440b service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:36.635529 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1c1cd-b851-4caa-8f67-d54f0067440b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:36.637698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f0c1c1cd-b851-4caa-8f67-d54f0067440b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:36.726438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1c1cd-b851-4caa-8f67-d54f0067440b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:36.727986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1c1cd-b851-4caa-8f67-d54f0067440b service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:36.745871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 708/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:37.664911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef4b67-15f7-4afd-9ec9-ea42c042e979 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:37.665509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef4b67-15f7-4afd-9ec9-ea42c042e979 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:37.665509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef4b67-15f7-4afd-9ec9-ea42c042e979 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:37.666852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:37.672257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7124b-d811-42e1-b9a5-2b82d1f5e998 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:37.672703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7124b-d811-42e1-b9a5-2b82d1f5e998 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:37.672811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7124b-d811-42e1-b9a5-2b82d1f5e998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:37.748581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-56d7124b-d811-42e1-b9a5-2b82d1f5e998 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:37.749833 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-56d7124b-d811-42e1-b9a5-2b82d1f5e998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:37.776834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:37.847294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:37.997600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef4b67-15f7-4afd-9ec9-ea42c042e979 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:37.999012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5aef4b67-15f7-4afd-9ec9-ea42c042e979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:38.142573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef4b67-15f7-4afd-9ec9-ea42c042e979 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:38.302467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:38.375664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6ed2f-674a-48ae-8d80-1ccb5951258b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:38.376269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ed2f-674a-48ae-8d80-1ccb5951258b service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:38.376544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ed2f-674a-48ae-8d80-1ccb5951258b service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:38.376842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6ed2f-674a-48ae-8d80-1ccb5951258b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:38.378438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4de6ed2f-674a-48ae-8d80-1ccb5951258b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:38.466752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6ed2f-674a-48ae-8d80-1ccb5951258b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:38.468326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6ed2f-674a-48ae-8d80-1ccb5951258b service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:38.486566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 710/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:39.365601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72d758-7152-4502-9bf7-6840c071a334 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:39.366140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72d758-7152-4502-9bf7-6840c071a334 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:39.366253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72d758-7152-4502-9bf7-6840c071a334 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:39.367528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:39.373087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1decf-3d05-4ef6-b8b7-bda90521f80f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:39.373471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1decf-3d05-4ef6-b8b7-bda90521f80f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:39.373620 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1decf-3d05-4ef6-b8b7-bda90521f80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:39.439124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:39.461817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5ba1decf-3d05-4ef6-b8b7-bda90521f80f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:39.463009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5ba1decf-3d05-4ef6-b8b7-bda90521f80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:39.561854 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:39.717397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72d758-7152-4502-9bf7-6840c071a334 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:39.718718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-be72d758-7152-4502-9bf7-6840c071a334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:39.863205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72d758-7152-4502-9bf7-6840c071a334 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:39.875329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:39.974983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bc6e0-46e0-4055-b31e-03eff4a3bada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:39.975513 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bc6e0-46e0-4055-b31e-03eff4a3bada service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:39.975786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bc6e0-46e0-4055-b31e-03eff4a3bada service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:39.976052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bc6e0-46e0-4055-b31e-03eff4a3bada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:39.977787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-765bc6e0-46e0-4055-b31e-03eff4a3bada service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:40.067104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bc6e0-46e0-4055-b31e-03eff4a3bada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:40.068763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bc6e0-46e0-4055-b31e-03eff4a3bada service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:40.087146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 711/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:40.949675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a0a9-704c-49c0-a377-ca8045ac85a0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:40.950240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a0a9-704c-49c0-a377-ca8045ac85a0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:40.950240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a0a9-704c-49c0-a377-ca8045ac85a0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:40.951567 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:40.956556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82dba1-8398-4730-adfd-bd72de573e77 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:40.957018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82dba1-8398-4730-adfd-bd72de573e77 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:40.957163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82dba1-8398-4730-adfd-bd72de573e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:40.976511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:41.031788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-1a82dba1-8398-4730-adfd-bd72de573e77 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:41.033100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1a82dba1-8398-4730-adfd-bd72de573e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:41.131424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:41.283909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a0a9-704c-49c0-a377-ca8045ac85a0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:41.285373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-01e7a0a9-704c-49c0-a377-ca8045ac85a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:41.393673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:41.434660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a0a9-704c-49c0-a377-ca8045ac85a0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:41.546066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff42e0-64b0-4492-be23-b4032cded20e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:41.546593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff42e0-64b0-4492-be23-b4032cded20e service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:41.546866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff42e0-64b0-4492-be23-b4032cded20e service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:41.547129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff42e0-64b0-4492-be23-b4032cded20e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:41.548810 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8fff42e0-64b0-4492-be23-b4032cded20e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:41.626098 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:41.640213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff42e0-64b0-4492-be23-b4032cded20e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:41.641825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff42e0-64b0-4492-be23-b4032cded20e service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:41.660422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 713/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:42.524544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55ddb9-d6b8-4681-b50d-28d14b1e7e03 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:42.525090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55ddb9-d6b8-4681-b50d-28d14b1e7e03 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:42.525090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55ddb9-d6b8-4681-b50d-28d14b1e7e03 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:42.526479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:42.531357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb320f22-c8c8-47f2-a422-842cd8e69ac2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:42.531786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb320f22-c8c8-47f2-a422-842cd8e69ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:42.531899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb320f22-c8c8-47f2-a422-842cd8e69ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:42.606988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-eb320f22-c8c8-47f2-a422-842cd8e69ac2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:42.608192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-eb320f22-c8c8-47f2-a422-842cd8e69ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:42.703354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:42.852956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55ddb9-d6b8-4681-b50d-28d14b1e7e03 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:42.854976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-7a55ddb9-d6b8-4681-b50d-28d14b1e7e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:42.938101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:42.999357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55ddb9-d6b8-4681-b50d-28d14b1e7e03 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:43.110507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3dead-5a7b-488f-b6e0-efed41a743e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:43.111040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3dead-5a7b-488f-b6e0-efed41a743e9 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:43.111317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3dead-5a7b-488f-b6e0-efed41a743e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:43.111596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3dead-5a7b-488f-b6e0-efed41a743e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:43.113220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bdf3dead-5a7b-488f-b6e0-efed41a743e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:43.160798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:43.202183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3dead-5a7b-488f-b6e0-efed41a743e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:43.203809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3dead-5a7b-488f-b6e0-efed41a743e9 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:43.222024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 714/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:44.039193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f095e-b334-4e29-88ac-701df0d5345e None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:44.039769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f095e-b334-4e29-88ac-701df0d5345e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:44.039769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f095e-b334-4e29-88ac-701df0d5345e None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:44.041157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:44.046855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6942de-2c87-40ee-ad3a-de1d4e47f3f6 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:44.047306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6942de-2c87-40ee-ad3a-de1d4e47f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:44.047415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6942de-2c87-40ee-ad3a-de1d4e47f3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:44.123266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ed6942de-2c87-40ee-ad3a-de1d4e47f3f6 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:44.124471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ed6942de-2c87-40ee-ad3a-de1d4e47f3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:44.224322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:44.374370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f095e-b334-4e29-88ac-701df0d5345e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:44.375876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e99f095e-b334-4e29-88ac-701df0d5345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:44.425006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:44.522201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f095e-b334-4e29-88ac-701df0d5345e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:44.632931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfcda0-a7b7-408a-acfc-3b08cca82a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:44.633459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfcda0-a7b7-408a-acfc-3b08cca82a48 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:44.633732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfcda0-a7b7-408a-acfc-3b08cca82a48 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:44.633997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfcda0-a7b7-408a-acfc-3b08cca82a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:44.636175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dcdfcda0-a7b7-408a-acfc-3b08cca82a48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:44.643066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:44.725205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfcda0-a7b7-408a-acfc-3b08cca82a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:44.726787 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfcda0-a7b7-408a-acfc-3b08cca82a48 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:44.745001 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 716/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:45.549158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eed4b-c7d2-42e4-b0d8-96745e4ab58c None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:45.549720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eed4b-c7d2-42e4-b0d8-96745e4ab58c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:45.549720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eed4b-c7d2-42e4-b0d8-96745e4ab58c None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:45.551060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:45.556041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227ed6-f384-4299-b652-92640c2e28d1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:45.556487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227ed6-f384-4299-b652-92640c2e28d1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:45.556585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227ed6-f384-4299-b652-92640c2e28d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:45.632674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e1227ed6-f384-4299-b652-92640c2e28d1 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:45.633876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e1227ed6-f384-4299-b652-92640c2e28d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:45.699805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:45.729551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:45.882058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eed4b-c7d2-42e4-b0d8-96745e4ab58c None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:45.883572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bb9eed4b-c7d2-42e4-b0d8-96745e4ab58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:45.901456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:46.027848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eed4b-c7d2-42e4-b0d8-96745e4ab58c None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:46.113175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:46.138855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee0fe2-7143-4e94-b9b3-84a9b3c34abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:46.139458 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee0fe2-7143-4e94-b9b3-84a9b3c34abb service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:46.139733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee0fe2-7143-4e94-b9b3-84a9b3c34abb service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:46.139999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee0fe2-7143-4e94-b9b3-84a9b3c34abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:46.141611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-82ee0fe2-7143-4e94-b9b3-84a9b3c34abb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:46.231688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee0fe2-7143-4e94-b9b3-84a9b3c34abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:46.233314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee0fe2-7143-4e94-b9b3-84a9b3c34abb service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:46.251296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 717/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:47.052954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0177-f159-4124-9cc5-81838ca66410 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:47.053524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0177-f159-4124-9cc5-81838ca66410 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:47.053524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0177-f159-4124-9cc5-81838ca66410 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:47.054851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:47.060313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5000a0-ad29-46ac-81ce-28e70a75fe90 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:47.060773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5000a0-ad29-46ac-81ce-28e70a75fe90 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:47.060885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5000a0-ad29-46ac-81ce-28e70a75fe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:47.136276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9b5000a0-ad29-46ac-81ce-28e70a75fe90 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:47.137513 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9b5000a0-ad29-46ac-81ce-28e70a75fe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:47.179464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:47.235648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:47.387696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a0177-f159-4124-9cc5-81838ca66410 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:47.389285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-676a0177-f159-4124-9cc5-81838ca66410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:47.535735 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a0177-f159-4124-9cc5-81838ca66410 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:47.589661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:47.648184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39466cae-6932-475c-a06c-30a78f3b32d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:47.648741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39466cae-6932-475c-a06c-30a78f3b32d9 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:47.649018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39466cae-6932-475c-a06c-30a78f3b32d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:47.649286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39466cae-6932-475c-a06c-30a78f3b32d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:47.651471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-39466cae-6932-475c-a06c-30a78f3b32d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:47.739976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39466cae-6932-475c-a06c-30a78f3b32d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:47.741584 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39466cae-6932-475c-a06c-30a78f3b32d9 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:47.759571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 719/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:48.560765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c8a8e-4b47-437b-9769-fd7ff72dc4af None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:48.561279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c8a8e-4b47-437b-9769-fd7ff72dc4af None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:48.561279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c8a8e-4b47-437b-9769-fd7ff72dc4af None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:48.562647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:15:48.567490 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499ced6-bc0f-4080-98f9-5d1ce2aa80f6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:48.567931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499ced6-bc0f-4080-98f9-5d1ce2aa80f6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:48.568029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499ced6-bc0f-4080-98f9-5d1ce2aa80f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:48.643828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a499ced6-bc0f-4080-98f9-5d1ce2aa80f6 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:48.645063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a499ced6-bc0f-4080-98f9-5d1ce2aa80f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:48.647070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:48.741996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:48.892960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c8a8e-4b47-437b-9769-fd7ff72dc4af None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:48.894511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-328c8a8e-4b47-437b-9769-fd7ff72dc4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:49.039657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c8a8e-4b47-437b-9769-fd7ff72dc4af None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:49.066382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:49.154545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e72eb-2174-451a-a3a6-82e6df05d5c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:49.155150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e72eb-2174-451a-a3a6-82e6df05d5c0 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:49.155420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e72eb-2174-451a-a3a6-82e6df05d5c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:49.155683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e72eb-2174-451a-a3a6-82e6df05d5c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:49.157298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ec7e72eb-2174-451a-a3a6-82e6df05d5c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:49.245074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e72eb-2174-451a-a3a6-82e6df05d5c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:49.246736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e72eb-2174-451a-a3a6-82e6df05d5c0 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:49.265112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 720/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:51.253573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc36202-78b3-482f-94e7-009c92fcb82b None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:51.254115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc36202-78b3-482f-94e7-009c92fcb82b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:51.254268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc36202-78b3-482f-94e7-009c92fcb82b None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:51.255501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:51.260690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d5a96-1436-49c1-8000-1210dbf79ec2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:51.261140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d5a96-1436-49c1-8000-1210dbf79ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:51.261253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d5a96-1436-49c1-8000-1210dbf79ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:51.303526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:51.329794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-6c7d5a96-1436-49c1-8000-1210dbf79ec2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:51.331084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-6c7d5a96-1436-49c1-8000-1210dbf79ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:51.428026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:51.468347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc36202-78b3-482f-94e7-009c92fcb82b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:51.469919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6fc36202-78b3-482f-94e7-009c92fcb82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:51.575326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc36202-78b3-482f-94e7-009c92fcb82b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:51.607869 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:51.649049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19d043-b7d7-485e-b2b4-88926c8600ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:51.649647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19d043-b7d7-485e-b2b4-88926c8600ff service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:51.649921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19d043-b7d7-485e-b2b4-88926c8600ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:51.650188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19d043-b7d7-485e-b2b4-88926c8600ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:51.651806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dc19d043-b7d7-485e-b2b4-88926c8600ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:51.759096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19d043-b7d7-485e-b2b4-88926c8600ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:51.760765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19d043-b7d7-485e-b2b4-88926c8600ff service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:51.778224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 722/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:54.029531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b1104-b432-4a8f-a241-fc3b9b28b226 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:54.030102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b1104-b432-4a8f-a241-fc3b9b28b226 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:54.030102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b1104-b432-4a8f-a241-fc3b9b28b226 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:54.031464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:54.036584 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfc138-64cc-4b61-bf49-ef7cd397d4b8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:54.037020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfc138-64cc-4b61-bf49-ef7cd397d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:54.037165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfc138-64cc-4b61-bf49-ef7cd397d4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:54.102362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9fdfc138-64cc-4b61-bf49-ef7cd397d4b8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:54.103554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9fdfc138-64cc-4b61-bf49-ef7cd397d4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:54.116901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:54.201448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:54.240124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b1104-b432-4a8f-a241-fc3b9b28b226 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:54.241708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4c3b1104-b432-4a8f-a241-fc3b9b28b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:54.345006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b1104-b432-4a8f-a241-fc3b9b28b226 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:54.357694 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:54.422281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb02194-bd3f-4b92-b47a-e95648e5cb17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:54.422897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb02194-bd3f-4b92-b47a-e95648e5cb17 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:54.423179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb02194-bd3f-4b92-b47a-e95648e5cb17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:54.423444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb02194-bd3f-4b92-b47a-e95648e5cb17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:54.425078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8bb02194-bd3f-4b92-b47a-e95648e5cb17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:54.531553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb02194-bd3f-4b92-b47a-e95648e5cb17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:54.533024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb02194-bd3f-4b92-b47a-e95648e5cb17 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:54.551580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 723/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:56.863660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9634d-06e1-44c8-923e-a8de2af8fe8c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:56.864214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9634d-06e1-44c8-923e-a8de2af8fe8c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:56.864214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9634d-06e1-44c8-923e-a8de2af8fe8c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:56.865627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:56.870777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31037af6-8bc1-4f68-a233-f957fa0af71e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:56.871168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31037af6-8bc1-4f68-a233-f957fa0af71e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:56.871326 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31037af6-8bc1-4f68-a233-f957fa0af71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:56.919337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:56.937222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-31037af6-8bc1-4f68-a233-f957fa0af71e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:56.938414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-31037af6-8bc1-4f68-a233-f957fa0af71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:57.032583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:57.071830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9634d-06e1-44c8-923e-a8de2af8fe8c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:57.074171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-24f9634d-06e1-44c8-923e-a8de2af8fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:57.179183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9634d-06e1-44c8-923e-a8de2af8fe8c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:57.220156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:57.253952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef125c-2153-45e4-baa8-c90ef4ed3aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:57.254545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef125c-2153-45e4-baa8-c90ef4ed3aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:57.254816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef125c-2153-45e4-baa8-c90ef4ed3aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:57.255079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef125c-2153-45e4-baa8-c90ef4ed3aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:57.256674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f5ef125c-2153-45e4-baa8-c90ef4ed3aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:57.365099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef125c-2153-45e4-baa8-c90ef4ed3aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:57.366525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef125c-2153-45e4-baa8-c90ef4ed3aa6 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:57.384717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 725/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:59.525108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306f4a-c7de-4f38-8a71-314f092f6acd None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:59.525672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306f4a-c7de-4f38-8a71-314f092f6acd None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:59.525672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306f4a-c7de-4f38-8a71-314f092f6acd None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:59.527714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:59.533126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1a7bc-6905-4157-8524-0d5c006d816b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:59.533562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1a7bc-6905-4157-8524-0d5c006d816b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:59.533664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1a7bc-6905-4157-8524-0d5c006d816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:59.601031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ced1a7bc-6905-4157-8524-0d5c006d816b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:59.602238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ced1a7bc-6905-4157-8524-0d5c006d816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:59.623110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:59.698899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:59.738487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3306f4a-c7de-4f38-8a71-314f092f6acd None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:59.740016 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a3306f4a-c7de-4f38-8a71-314f092f6acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:59.844145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3306f4a-c7de-4f38-8a71-314f092f6acd None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:59.863915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:59.917153 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305d1c3-4fbb-4435-a3a3-f31fcbbca209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:59.917755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d1c3-4fbb-4435-a3a3-f31fcbbca209 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:59.918032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d1c3-4fbb-4435-a3a3-f31fcbbca209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:59.918302 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d1c3-4fbb-4435-a3a3-f31fcbbca209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:59.920152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3305d1c3-4fbb-4435-a3a3-f31fcbbca209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:00.027229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305d1c3-4fbb-4435-a3a3-f31fcbbca209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:00.028603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305d1c3-4fbb-4435-a3a3-f31fcbbca209 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:00.046555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 726/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:02.083183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fac8fe-544e-4d7a-ac6f-d5c1a3752ae0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:02.083774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fac8fe-544e-4d7a-ac6f-d5c1a3752ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:02.083774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fac8fe-544e-4d7a-ac6f-d5c1a3752ae0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:02.085095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:02.091080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30132401-20a1-42fd-8316-214dd58bb5cf None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:02.091480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30132401-20a1-42fd-8316-214dd58bb5cf None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:02.091628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30132401-20a1-42fd-8316-214dd58bb5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:02.157462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:02.160473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-30132401-20a1-42fd-8316-214dd58bb5cf None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:02.162308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-30132401-20a1-42fd-8316-214dd58bb5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:02.256872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:02.295841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fac8fe-544e-4d7a-ac6f-d5c1a3752ae0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:02.297376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-11fac8fe-544e-4d7a-ac6f-d5c1a3752ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:02.403107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fac8fe-544e-4d7a-ac6f-d5c1a3752ae0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:02.452719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:02.477503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb4794-60b8-4331-b460-4f87def1ace1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:02.478102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4794-60b8-4331-b460-4f87def1ace1 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:02.478375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4794-60b8-4331-b460-4f87def1ace1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:02.478638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4794-60b8-4331-b460-4f87def1ace1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:02.480273 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-35cb4794-60b8-4331-b460-4f87def1ace1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:02.587546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb4794-60b8-4331-b460-4f87def1ace1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:02.589069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb4794-60b8-4331-b460-4f87def1ace1 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:02.606619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 728/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:04.699291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf535b2-f92c-40e9-9d9b-f71ffaa5c768 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:04.699848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf535b2-f92c-40e9-9d9b-f71ffaa5c768 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:04.699848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf535b2-f92c-40e9-9d9b-f71ffaa5c768 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:04.701324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:04.706679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29e11-9b08-464b-aad3-5f0645b425fa None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:04.707127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29e11-9b08-464b-aad3-5f0645b425fa None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:04.707247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29e11-9b08-464b-aad3-5f0645b425fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:04.772544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d2b29e11-9b08-464b-aad3-5f0645b425fa None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:04.773754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d2b29e11-9b08-464b-aad3-5f0645b425fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:04.803322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:04.870008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:04.907857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf535b2-f92c-40e9-9d9b-f71ffaa5c768 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:04.909503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bdf535b2-f92c-40e9-9d9b-f71ffaa5c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:05.013303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf535b2-f92c-40e9-9d9b-f71ffaa5c768 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:05.041097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:05.086179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85d9b9-4658-42e5-8e27-56e6377ba6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:05.086774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d9b9-4658-42e5-8e27-56e6377ba6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:05.087049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d9b9-4658-42e5-8e27-56e6377ba6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:05.087313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d9b9-4658-42e5-8e27-56e6377ba6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:05.089753 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1e85d9b9-4658-42e5-8e27-56e6377ba6a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:05.198921 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85d9b9-4658-42e5-8e27-56e6377ba6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:05.200367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85d9b9-4658-42e5-8e27-56e6377ba6a7 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:05.219192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 729/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:07.279356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f03f3-ccf0-43c8-a89d-8058ef31f413 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:07.279905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f03f3-ccf0-43c8-a89d-8058ef31f413 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:07.279905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f03f3-ccf0-43c8-a89d-8058ef31f413 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:07.281262 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:07.286385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4b36c-55fb-421c-92c3-492c0007f331 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:07.286769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4b36c-55fb-421c-92c3-492c0007f331 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:07.286916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4b36c-55fb-421c-92c3-492c0007f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:07.352068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-05a4b36c-55fb-421c-92c3-492c0007f331 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:07.353280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-05a4b36c-55fb-421c-92c3-492c0007f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:07.361383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:07.448737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:07.486762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f03f3-ccf0-43c8-a89d-8058ef31f413 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:07.488299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e20f03f3-ccf0-43c8-a89d-8058ef31f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:07.589952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f03f3-ccf0-43c8-a89d-8058ef31f413 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:07.645616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:07.669889 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3539f0-f05d-4d72-945a-3934d2acbd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:07.670486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3539f0-f05d-4d72-945a-3934d2acbd8d service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:07.670764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3539f0-f05d-4d72-945a-3934d2acbd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:07.671031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3539f0-f05d-4d72-945a-3934d2acbd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:07.672616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7c3539f0-f05d-4d72-945a-3934d2acbd8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:07.780607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3539f0-f05d-4d72-945a-3934d2acbd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:07.782065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3539f0-f05d-4d72-945a-3934d2acbd8d service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:07.799986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 731/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:09.904457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266d968-4b5b-4402-869b-de09fd887fed None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:09.905041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266d968-4b5b-4402-869b-de09fd887fed None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:09.905041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266d968-4b5b-4402-869b-de09fd887fed None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:09.906384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:09.911683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2126ea-9a6b-4a26-a0e2-e81011d607f5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:09.912097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2126ea-9a6b-4a26-a0e2-e81011d607f5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:09.912233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2126ea-9a6b-4a26-a0e2-e81011d607f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:09.980131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-cd2126ea-9a6b-4a26-a0e2-e81011d607f5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:09.981357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cd2126ea-9a6b-4a26-a0e2-e81011d607f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:10.018758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:10.077715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:10.115544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266d968-4b5b-4402-869b-de09fd887fed None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:10.117310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5266d968-4b5b-4402-869b-de09fd887fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:10.225340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266d968-4b5b-4402-869b-de09fd887fed None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:10.263531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:10.299709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd086aee-6612-4c89-b1a1-2cf6482e4e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:10.300307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd086aee-6612-4c89-b1a1-2cf6482e4e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:10.300600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd086aee-6612-4c89-b1a1-2cf6482e4e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:10.300888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd086aee-6612-4c89-b1a1-2cf6482e4e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:10.302479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-dd086aee-6612-4c89-b1a1-2cf6482e4e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:10.410441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd086aee-6612-4c89-b1a1-2cf6482e4e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:10.411880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd086aee-6612-4c89-b1a1-2cf6482e4e50 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:10.430537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 732/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:12.447957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9be312-91f8-4aac-a24e-b7f6d5dd9684 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:12.449223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9be312-91f8-4aac-a24e-b7f6d5dd9684 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:12.449500 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9be312-91f8-4aac-a24e-b7f6d5dd9684 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:12.450899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:12.456170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694337d-0697-40d8-b77f-dea867eb876c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:12.456649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694337d-0697-40d8-b77f-dea867eb876c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:12.456851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694337d-0697-40d8-b77f-dea867eb876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:12.522660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-b694337d-0697-40d8-b77f-dea867eb876c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:12.523885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b694337d-0697-40d8-b77f-dea867eb876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:12.541867 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:12.620789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:12.656898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9be312-91f8-4aac-a24e-b7f6d5dd9684 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:12.658510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3e9be312-91f8-4aac-a24e-b7f6d5dd9684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:12.762022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9be312-91f8-4aac-a24e-b7f6d5dd9684 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:12.827749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:12.834932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb5bca-9b86-445f-b09a-bfe5c76a9e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:12.835529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5bca-9b86-445f-b09a-bfe5c76a9e62 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:12.835803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5bca-9b86-445f-b09a-bfe5c76a9e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:12.836070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5bca-9b86-445f-b09a-bfe5c76a9e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:12.837693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f3fb5bca-9b86-445f-b09a-bfe5c76a9e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:12.944055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb5bca-9b86-445f-b09a-bfe5c76a9e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:12.945508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb5bca-9b86-445f-b09a-bfe5c76a9e62 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:12.963151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 734/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:14.990081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b226-4ba6-488c-8699-565248661ed8 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:14.990636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b226-4ba6-488c-8699-565248661ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:14.990636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b226-4ba6-488c-8699-565248661ed8 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:14.991975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:14.997826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd866c-d168-4526-aca6-330839a58443 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:14.998222 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd866c-d168-4526-aca6-330839a58443 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:14.998373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd866c-d168-4526-aca6-330839a58443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:15.063506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-42dd866c-d168-4526-aca6-330839a58443 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:15.064648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-42dd866c-d168-4526-aca6-330839a58443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:15.114628 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:15.164422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:15.202465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32b226-4ba6-488c-8699-565248661ed8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:15.203983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5f32b226-4ba6-488c-8699-565248661ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:15.307183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32b226-4ba6-488c-8699-565248661ed8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:15.354670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:15.380440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bec44-98b3-4f1d-8821-5d31dd265990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:15.381072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bec44-98b3-4f1d-8821-5d31dd265990 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:15.381349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bec44-98b3-4f1d-8821-5d31dd265990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:15.381612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bec44-98b3-4f1d-8821-5d31dd265990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:15.383182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f80bec44-98b3-4f1d-8821-5d31dd265990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:15.490510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bec44-98b3-4f1d-8821-5d31dd265990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:15.491950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bec44-98b3-4f1d-8821-5d31dd265990 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:15.510250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 735/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:25.162644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=22 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:25.508007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=66 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:35.098036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbf6ce-0d4a-4eb9-b77e-44d59b45c5ce None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:35.098596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbf6ce-0d4a-4eb9-b77e-44d59b45c5ce None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:35.098596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbf6ce-0d4a-4eb9-b77e-44d59b45c5ce None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:35.099949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 736/1471] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:35.105821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95878f-befe-4670-9d47-10722189248c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:35.106324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95878f-befe-4670-9d47-10722189248c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:35.106427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95878f-befe-4670-9d47-10722189248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:35.177759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-6d95878f-befe-4670-9d47-10722189248c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:35.178936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-6d95878f-befe-4670-9d47-10722189248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:35.274659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 736/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:35.358536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017b629-3b78-404d-9410-12a2eb928e2f None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:35.358812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017b629-3b78-404d-9410-12a2eb928e2f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:35.359081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017b629-3b78-404d-9410-12a2eb928e2f None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:35.360416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 737/1473] 10.222.0.25 () {54 vars in 967 bytes} [Tue Aug 9 12:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:35.365282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57f33-1a81-4d7f-ada5-1c248e48c8b1 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:35.365568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57f33-1a81-4d7f-ada5-1c248e48c8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:35.365839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f57f33-1a81-4d7f-ada5-1c248e48c8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:35.442132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c7f57f33-1a81-4d7f-ada5-1c248e48c8b1 None None] MFA Rules not processed for user `79efccae1afa46e78c25f617bf2dd9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:35.443334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c7f57f33-1a81-4d7f-ada5-1c248e48c8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:35.463369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:35.518835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 737/1474] 10.222.0.25 () {58 vars in 1064 bytes} [Tue Aug 9 12:16:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:35.527295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017b629-3b78-404d-9410-12a2eb928e2f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:35.528915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7017b629-3b78-404d-9410-12a2eb928e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:35.631137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017b629-3b78-404d-9410-12a2eb928e2f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:35.702753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49076e4a-791c-4a92-bdb7-c94702bcde7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79efccae1afa46e78c25f617bf2dd9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:35.703350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49076e4a-791c-4a92-bdb7-c94702bcde7f service glance] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:35.703628 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49076e4a-791c-4a92-bdb7-c94702bcde7f service glance] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:35.703896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49076e4a-791c-4a92-bdb7-c94702bcde7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:35.705514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-49076e4a-791c-4a92-bdb7-c94702bcde7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:35.760109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:35.814763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49076e4a-791c-4a92-bdb7-c94702bcde7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:35.816178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49076e4a-791c-4a92-bdb7-c94702bcde7f service glance] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:35.834675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 738/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:37.933565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d13962-74c0-4c40-9318-98277f070c30 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:37.934170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d13962-74c0-4c40-9318-98277f070c30 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:37.934170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d13962-74c0-4c40-9318-98277f070c30 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:37.935447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 738/1476] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:37.940511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150ab6-4860-459e-a5dc-5b358daf4cf9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:37.940921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150ab6-4860-459e-a5dc-5b358daf4cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:37.941080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150ab6-4860-459e-a5dc-5b358daf4cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:38.006141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-91150ab6-4860-459e-a5dc-5b358daf4cf9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:38.007333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-91150ab6-4860-459e-a5dc-5b358daf4cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:38.102891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 739/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:38.126050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d13962-74c0-4c40-9318-98277f070c30 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:38.127554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-76d13962-74c0-4c40-9318-98277f070c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:38.252128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d13962-74c0-4c40-9318-98277f070c30 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:38.300512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:38.346164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd70df-f41e-4569-bd74-cc554a3599ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:38.346772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd70df-f41e-4569-bd74-cc554a3599ff admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:38.347048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd70df-f41e-4569-bd74-cc554a3599ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:38.347317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd70df-f41e-4569-bd74-cc554a3599ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:38.347947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd70df-f41e-4569-bd74-cc554a3599ff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:38.349760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WARNING py.warnings [None req-b1cd70df-f41e-4569-bd74-cc554a3599ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:16:38.349760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: warnings.warn(msg) Aug 09 12:16:38.349760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: Aug 09 12:16:38.350987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd70df-f41e-4569-bd74-cc554a3599ff admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:38.370553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 739/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Aug 9 12:16:38 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:16:40.389180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5dcc0-b8a5-421a-88c6-f8f867e921ee None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:40.389710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5dcc0-b8a5-421a-88c6-f8f867e921ee None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:40.389710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5dcc0-b8a5-421a-88c6-f8f867e921ee None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:40.391065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 740/1479] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:40.396293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770ab12-61ae-4c16-8399-7eabd9e642ae None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:40.396764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770ab12-61ae-4c16-8399-7eabd9e642ae None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:40.396869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770ab12-61ae-4c16-8399-7eabd9e642ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:40.582770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-8770ab12-61ae-4c16-8399-7eabd9e642ae None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:40.583897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8770ab12-61ae-4c16-8399-7eabd9e642ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:40.681280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 740/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:40.725301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5dcc0-b8a5-421a-88c6-f8f867e921ee None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:40.726866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fbf5dcc0-b8a5-421a-88c6-f8f867e921ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:40.737359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:40.871401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5dcc0-b8a5-421a-88c6-f8f867e921ee None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:40.951070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:40.984117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e64c-345d-4d1f-96f9-f562c5cc47b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:40.984743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e64c-345d-4d1f-96f9-f562c5cc47b6 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:40.985022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e64c-345d-4d1f-96f9-f562c5cc47b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:40.985287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e64c-345d-4d1f-96f9-f562c5cc47b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:40.986877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c632e64c-345d-4d1f-96f9-f562c5cc47b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:41.073812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632e64c-345d-4d1f-96f9-f562c5cc47b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:41.075392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632e64c-345d-4d1f-96f9-f562c5cc47b6 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:41.093471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 741/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:43.267988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514835-e815-4e60-8fc5-33cb1e9a54c8 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:43.268569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514835-e815-4e60-8fc5-33cb1e9a54c8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:43.268569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514835-e815-4e60-8fc5-33cb1e9a54c8 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:43.269913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 741/1482] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:43.274993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3559-cfe5-40f7-9165-e9a65bca19f9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:43.275414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3559-cfe5-40f7-9165-e9a65bca19f9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:43.275524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f3559-cfe5-40f7-9165-e9a65bca19f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:43.340413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-960f3559-cfe5-40f7-9165-e9a65bca19f9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:43.341638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-960f3559-cfe5-40f7-9165-e9a65bca19f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:43.386956 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:43.438987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 742/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:43.474756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514835-e815-4e60-8fc5-33cb1e9a54c8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:43.476274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bf514835-e815-4e60-8fc5-33cb1e9a54c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:43.500356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:43.578306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514835-e815-4e60-8fc5-33cb1e9a54c8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:43.650157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcc2d1-c1ac-4595-902f-237b24901797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:43.650755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcc2d1-c1ac-4595-902f-237b24901797 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:43.651027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcc2d1-c1ac-4595-902f-237b24901797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:43.651357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcc2d1-c1ac-4595-902f-237b24901797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:43.653102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-edbcc2d1-c1ac-4595-902f-237b24901797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:43.724793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:43.761062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcc2d1-c1ac-4595-902f-237b24901797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:43.762500 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcc2d1-c1ac-4595-902f-237b24901797 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:43.781060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 742/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:45.855445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1e19-e1f2-43f4-a82a-304ba20bf11d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:45.855958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1e19-e1f2-43f4-a82a-304ba20bf11d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:45.855958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1e19-e1f2-43f4-a82a-304ba20bf11d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:45.857313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 743/1485] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:45.862416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc7990-bac5-4ab5-bad5-f45d8bf4ced9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:45.862813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc7990-bac5-4ab5-bad5-f45d8bf4ced9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:45.862958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc7990-bac5-4ab5-bad5-f45d8bf4ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:45.931477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-47dc7990-bac5-4ab5-bad5-f45d8bf4ced9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:45.933400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-47dc7990-bac5-4ab5-bad5-f45d8bf4ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:46.029771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 743/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:46.068083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba1e19-e1f2-43f4-a82a-304ba20bf11d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:46.069642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-43ba1e19-e1f2-43f4-a82a-304ba20bf11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:46.173262 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba1e19-e1f2-43f4-a82a-304ba20bf11d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:46.244677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:46.246672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444274-9c88-4ee3-b503-d46935c03935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:46.247279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444274-9c88-4ee3-b503-d46935c03935 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:46.247736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444274-9c88-4ee3-b503-d46935c03935 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:46.248177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444274-9c88-4ee3-b503-d46935c03935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:46.250067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-57444274-9c88-4ee3-b503-d46935c03935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:46.356957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57444274-9c88-4ee3-b503-d46935c03935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:46.358378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57444274-9c88-4ee3-b503-d46935c03935 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:46.376911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 744/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:48.477914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ace9a-cea3-4f92-8de6-423ab43a9f8b None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:48.478418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ace9a-cea3-4f92-8de6-423ab43a9f8b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:48.478418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ace9a-cea3-4f92-8de6-423ab43a9f8b None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:48.480391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 744/1488] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:48.485745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2e6f9-c083-4a8d-8ef6-5bc8cc4f4f8e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:48.486167 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2e6f9-c083-4a8d-8ef6-5bc8cc4f4f8e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:48.486269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2e6f9-c083-4a8d-8ef6-5bc8cc4f4f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:48.551000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-87c2e6f9-c083-4a8d-8ef6-5bc8cc4f4f8e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:48.552221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-87c2e6f9-c083-4a8d-8ef6-5bc8cc4f4f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:48.603371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:48.647802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 745/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:48.688774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ace9a-cea3-4f92-8de6-423ab43a9f8b None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:48.690297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1d1ace9a-cea3-4f92-8de6-423ab43a9f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:48.726588 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:48.794698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ace9a-cea3-4f92-8de6-423ab43a9f8b None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:48.867773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b5e51-d58d-493c-87af-14a697796a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:48.868378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5e51-d58d-493c-87af-14a697796a68 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:48.868669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5e51-d58d-493c-87af-14a697796a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:48.868938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5e51-d58d-493c-87af-14a697796a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:48.870609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-819b5e51-d58d-493c-87af-14a697796a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:48.949562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:48.978476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b5e51-d58d-493c-87af-14a697796a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:48.979956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b5e51-d58d-493c-87af-14a697796a68 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:48.998123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 745/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:51.189276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eec40-1ddc-41c7-8286-cbdb02de26f0 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:51.189837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eec40-1ddc-41c7-8286-cbdb02de26f0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:51.189837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eec40-1ddc-41c7-8286-cbdb02de26f0 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:51.191215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 746/1491] 10.222.0.25 () {54 vars in 927 bytes} [Tue Aug 9 12:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:51.196522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbef64-a1b2-4182-8958-0776831a7a8c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:51.196958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbef64-a1b2-4182-8958-0776831a7a8c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:51.197102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbef64-a1b2-4182-8958-0776831a7a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:51.265104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5abbef64-a1b2-4182-8958-0776831a7a8c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:51.266298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5abbef64-a1b2-4182-8958-0776831a7a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:51.364726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 746/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Aug 9 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:51.404720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eec40-1ddc-41c7-8286-cbdb02de26f0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:51.406255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5e4eec40-1ddc-41c7-8286-cbdb02de26f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:51.519843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eec40-1ddc-41c7-8286-cbdb02de26f0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:51.600259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535812e9-d588-48d0-a34a-61c0737124ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:51.600907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535812e9-d588-48d0-a34a-61c0737124ef service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:51.601185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535812e9-d588-48d0-a34a-61c0737124ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:51.601450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535812e9-d588-48d0-a34a-61c0737124ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:51.603163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-535812e9-d588-48d0-a34a-61c0737124ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:51.621464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:51.759948 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535812e9-d588-48d0-a34a-61c0737124ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:51.762385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535812e9-d588-48d0-a34a-61c0737124ef service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:51.782231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 747/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:17:01.362984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=82 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:01.779538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=50 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:02.296866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176b76c-a36a-44e1-8e8b-6ebf12d8bae9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:02.297367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176b76c-a36a-44e1-8e8b-6ebf12d8bae9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:02.297479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176b76c-a36a-44e1-8e8b-6ebf12d8bae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:02.372861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d176b76c-a36a-44e1-8e8b-6ebf12d8bae9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:18:02.374068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d176b76c-a36a-44e1-8e8b-6ebf12d8bae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:02.473135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 747/1494] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:18:02.481992 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d734ca4-ae28-48e5-8265-5cc97734a7c9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:02.482520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d734ca4-ae28-48e5-8265-5cc97734a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:02.482520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d734ca4-ae28-48e5-8265-5cc97734a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:02.557559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4d734ca4-ae28-48e5-8265-5cc97734a7c9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:18:02.558401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4d734ca4-ae28-48e5-8265-5cc97734a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:02.654218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 748/1495] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:18:02.658936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176b76c-a36a-44e1-8e8b-6ebf12d8bae9 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:02.660137 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d176b76c-a36a-44e1-8e8b-6ebf12d8bae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:02.672185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176b76c-a36a-44e1-8e8b-6ebf12d8bae9 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:02.733072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:02.765465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:02.766065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:02.766340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:02.766603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:02.767236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:18:02.767530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:02.768539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WARNING py.warnings [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:02.768539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: warnings.warn(msg) Aug 09 12:18:02.768539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: Aug 09 12:18:02.769453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:02.781351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 748/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:18:02.789621 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d734ca4-ae28-48e5-8265-5cc97734a7c9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:02.800896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d734ca4-ae28-48e5-8265-5cc97734a7c9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:02.862525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:02.896294 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a9806-2744-4394-95b3-ba12894df122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:02.896924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a9806-2744-4394-95b3-ba12894df122 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:02.897199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a9806-2744-4394-95b3-ba12894df122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:02.897461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a9806-2744-4394-95b3-ba12894df122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:02.898087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a9806-2744-4394-95b3-ba12894df122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:02.899791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: WARNING py.warnings [None req-722a9806-2744-4394-95b3-ba12894df122 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:02.899791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: warnings.warn(msg) Aug 09 12:18:02.899791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: Aug 09 12:18:02.901695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a9806-2744-4394-95b3-ba12894df122 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:02.957078 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 749/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:18:02 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:18:02.961403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:02.962985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:02.996878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b51198-5a48-4542-9bf6-f0891f0b6449 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:03.092971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad7ed-f9fa-4f20-9899-e9e692ab094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:03.093587 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad7ed-f9fa-4f20-9899-e9e692ab094a admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:03.093857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad7ed-f9fa-4f20-9899-e9e692ab094a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:03.094118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ad7ed-f9fa-4f20-9899-e9e692ab094a admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:03.094733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ad7ed-f9fa-4f20-9899-e9e692ab094a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:03.095732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WARNING py.warnings [None req-f15ad7ed-f9fa-4f20-9899-e9e692ab094a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:03.095732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: warnings.warn(msg) Aug 09 12:18:03.095732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: Aug 09 12:18:03.096951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ad7ed-f9fa-4f20-9899-e9e692ab094a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:03.139972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 749/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:18:02 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:18:03.144061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a9806-2744-4394-95b3-ba12894df122 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:03.145612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-722a9806-2744-4394-95b3-ba12894df122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:03.206925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a9806-2744-4394-95b3-ba12894df122 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:03.289686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:03.301645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc0f9e-2b0a-44b9-995c-7bed90bc7dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:03.302250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0f9e-2b0a-44b9-995c-7bed90bc7dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:03.302520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0f9e-2b0a-44b9-995c-7bed90bc7dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:03.302783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0f9e-2b0a-44b9-995c-7bed90bc7dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:03.303417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc0f9e-2b0a-44b9-995c-7bed90bc7dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:03.304422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: WARNING py.warnings [None req-8bfc0f9e-2b0a-44b9-995c-7bed90bc7dc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:03.304422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: warnings.warn(msg) Aug 09 12:18:03.304422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: Aug 09 12:18:03.305413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc0f9e-2b0a-44b9-995c-7bed90bc7dc2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:03.318834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 750/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:18:03.323595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad7ed-f9fa-4f20-9899-e9e692ab094a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:03.325137 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f15ad7ed-f9fa-4f20-9899-e9e692ab094a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:03.336465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ad7ed-f9fa-4f20-9899-e9e692ab094a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:03.360614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:03.430935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35ac4c-a0c7-490e-8136-08fbf280cb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:03.431539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35ac4c-a0c7-490e-8136-08fbf280cb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:03.431820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35ac4c-a0c7-490e-8136-08fbf280cb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:03.432721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35ac4c-a0c7-490e-8136-08fbf280cb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:03.433277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35ac4c-a0c7-490e-8136-08fbf280cb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:03.434289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WARNING py.warnings [None req-9f35ac4c-a0c7-490e-8136-08fbf280cb79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:03.434289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: warnings.warn(msg) Aug 09 12:18:03.434289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: Aug 09 12:18:03.435168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35ac4c-a0c7-490e-8136-08fbf280cb79 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:03.447261 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 750/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:18:03.452490 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc0f9e-2b0a-44b9-995c-7bed90bc7dc2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:03.454032 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8bfc0f9e-2b0a-44b9-995c-7bed90bc7dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:03.486693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc0f9e-2b0a-44b9-995c-7bed90bc7dc2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:03.579705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde84a58-d369-441e-a16e-ca704a29b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:03.580348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde84a58-d369-441e-a16e-ca704a29b344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:03.580618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde84a58-d369-441e-a16e-ca704a29b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:03.580910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde84a58-d369-441e-a16e-ca704a29b344 admin admin] PATH_INFO: `/v3/projects/a0a4eaec135f4f1195bf6ba39108f37d/users/7e95e2f7fa754fdda4ae96ca63ed7241/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:03.604475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde84a58-d369-441e-a16e-ca704a29b344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a4eaec135f4f1195bf6ba39108f37d, user_id=7e95e2f7fa754fdda4ae96ca63ed7241, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:03.605507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: WARNING py.warnings [None req-cde84a58-d369-441e-a16e-ca704a29b344 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:03.605507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: warnings.warn(msg) Aug 09 12:18:03.605507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: Aug 09 12:18:03.607406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde84a58-d369-441e-a16e-ca704a29b344 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:03.632080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 751/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:18:03 2022] PUT /identity/v3/projects/a0a4eaec135f4f1195bf6ba39108f37d/users/7e95e2f7fa754fdda4ae96ca63ed7241/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:18:03.644354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8529d-471b-4ec9-927a-275d5ae28fbf None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:03.644762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8529d-471b-4ec9-927a-275d5ae28fbf None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:03.645020 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8529d-471b-4ec9-927a-275d5ae28fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:03.701171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c0d8529d-471b-4ec9-927a-275d5ae28fbf None None] MFA Rules not processed for user `7e95e2f7fa754fdda4ae96ca63ed7241`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:18:03.702313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c0d8529d-471b-4ec9-927a-275d5ae28fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:03.778354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 751/1502] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:18:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:18:03.792045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f726d-d0df-4b4c-a2f7-42e26f7dad8a None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:03.792326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f726d-d0df-4b4c-a2f7-42e26f7dad8a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:03.792594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f726d-d0df-4b4c-a2f7-42e26f7dad8a None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:03.793969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 752/1503] 10.222.0.25 () {54 vars in 964 bytes} [Tue Aug 9 12:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:18:03.798908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efbe1c-efc9-4913-9066-0bb4d8a00afe None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:03.799189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efbe1c-efc9-4913-9066-0bb4d8a00afe None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:03.799457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efbe1c-efc9-4913-9066-0bb4d8a00afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:03.830668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:03.874950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-e7efbe1c-efc9-4913-9066-0bb4d8a00afe None None] MFA Rules not processed for user `f0b215bfb43742678bd5a728973dbc46`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:18:03.876155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e7efbe1c-efc9-4913-9066-0bb4d8a00afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:03.953199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 752/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Aug 9 12:18:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:18:03.960834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f726d-d0df-4b4c-a2f7-42e26f7dad8a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:03.962338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-904f726d-d0df-4b4c-a2f7-42e26f7dad8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:04.012543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:04.066816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f726d-d0df-4b4c-a2f7-42e26f7dad8a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:04.138863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10270830-ae84-4fac-820a-04275c7e8d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:04.139498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10270830-ae84-4fac-820a-04275c7e8d5e service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:04.139806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10270830-ae84-4fac-820a-04275c7e8d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:04.140077 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10270830-ae84-4fac-820a-04275c7e8d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:04.141710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-10270830-ae84-4fac-820a-04275c7e8d5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:04.240944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10270830-ae84-4fac-820a-04275c7e8d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:04.242290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10270830-ae84-4fac-820a-04275c7e8d5e service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:04.245943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:04.262051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 753/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:18:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:18:04.307745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72852-9e50-4768-829c-6228cda7ff7c None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:04.308019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72852-9e50-4768-829c-6228cda7ff7c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:04.308292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72852-9e50-4768-829c-6228cda7ff7c None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:04.309601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 753/1506] 10.222.0.25 () {52 vars in 830 bytes} [Tue Aug 9 12:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:18:04.313356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10270830-ae84-4fac-820a-04275c7e8d5e service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:04.314598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-10270830-ae84-4fac-820a-04275c7e8d5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:04.415170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10270830-ae84-4fac-820a-04275c7e8d5e service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:04.508803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:04.509434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:04.509616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:04.509881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] PATH_INFO: `/v3/users/7e95e2f7fa754fdda4ae96ca63ed7241` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:04.523070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e95e2f7fa754fdda4ae96ca63ed7241)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:04.524079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: WARNING py.warnings [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:04.524079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: warnings.warn(msg) Aug 09 12:18:04.524079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: Aug 09 12:18:04.525322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:04.535410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:04.591371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e95e2f7fa754fdda4ae96ca63ed7241'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:04.604894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e95e2f7fa754fdda4ae96ca63ed7241'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:04.605571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e95e2f7fa754fdda4ae96ca63ed7241'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:04.605987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e95e2f7fa754fdda4ae96ca63ed7241'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:04.614870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e95e2f7fa754fdda4ae96ca63ed7241'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:04.643189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 754/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:18:04 2022] DELETE /identity/v3/users/7e95e2f7fa754fdda4ae96ca63ed7241 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:18:04.647595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75257fcc-3461-4fcd-aafa-c78898f3c260 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:04.648085 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75257fcc-3461-4fcd-aafa-c78898f3c260 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:04.648190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75257fcc-3461-4fcd-aafa-c78898f3c260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:04.705550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-75257fcc-3461-4fcd-aafa-c78898f3c260 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:18:04.706762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-75257fcc-3461-4fcd-aafa-c78898f3c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:04.783103 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:04.796239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 754/1508] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:18:04.806073 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:04.807971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:04.909288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cf0e1-4c5e-4198-bab9-1d7a4410d970 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:04.964132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:04.984502 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a6a0a-dadd-4420-b0d6-1d0ec81e067e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:04.985136 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a6a0a-dadd-4420-b0d6-1d0ec81e067e service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:04.985412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a6a0a-dadd-4420-b0d6-1d0ec81e067e service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:04.985676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a6a0a-dadd-4420-b0d6-1d0ec81e067e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:04.987258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ea0a6a0a-dadd-4420-b0d6-1d0ec81e067e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:05.094088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a6a0a-dadd-4420-b0d6-1d0ec81e067e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:05.095439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a6a0a-dadd-4420-b0d6-1d0ec81e067e service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:05.115736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 755/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:18:05.446565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75257fcc-3461-4fcd-aafa-c78898f3c260 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:05.447796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-75257fcc-3461-4fcd-aafa-c78898f3c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:05.460257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75257fcc-3461-4fcd-aafa-c78898f3c260 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:05.556608 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:05.557292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:05.557564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:05.557827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] PATH_INFO: `/v3/projects/a0a4eaec135f4f1195bf6ba39108f37d` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:05.567444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a4eaec135f4f1195bf6ba39108f37d)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:05.568467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WARNING py.warnings [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:05.568467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: warnings.warn(msg) Aug 09 12:18:05.568467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: Aug 09 12:18:05.569687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:05.626537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a4eaec135f4f1195bf6ba39108f37d', 'request_id': 'req-f16cb420-2482-4112-91e2-d4e0b71baa4b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:05.632378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a4eaec135f4f1195bf6ba39108f37d', 'request_id': 'req-f16cb420-2482-4112-91e2-d4e0b71baa4b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:05.641470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a4eaec135f4f1195bf6ba39108f37d', 'request_id': 'req-f16cb420-2482-4112-91e2-d4e0b71baa4b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:05.671126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] The token cache is being invalidate because project a0a4eaec135f4f1195bf6ba39108f37d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:18:05.671709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:05.671819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f16cb420-2482-4112-91e2-d4e0b71baa4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:05.673159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 755/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:18:05 2022] DELETE /identity/v3/projects/a0a4eaec135f4f1195bf6ba39108f37d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:18:15.113837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=62 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:15.669086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:19:35.092441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb3db-9d4a-4198-a187-57832c63084d None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:35.093110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb3db-9d4a-4198-a187-57832c63084d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:35.093309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb3db-9d4a-4198-a187-57832c63084d None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:35.094683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:19:35.099700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c632c4-2245-4864-8855-3bd811d0650b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:35.100145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c632c4-2245-4864-8855-3bd811d0650b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:35.100253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c632c4-2245-4864-8855-3bd811d0650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:35.188406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c0c632c4-2245-4864-8855-3bd811d0650b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:19:35.189642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c0c632c4-2245-4864-8855-3bd811d0650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:35.289183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:19:35.442577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb3db-9d4a-4198-a187-57832c63084d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:19:35.444700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-41efb3db-9d4a-4198-a187-57832c63084d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:35.562387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb3db-9d4a-4198-a187-57832c63084d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:19:35.567707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f53462-3619-4389-bfa7-6e620ce7b49f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:19:35.568326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53462-3619-4389-bfa7-6e620ce7b49f service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:35.568598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53462-3619-4389-bfa7-6e620ce7b49f service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:35.568898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53462-3619-4389-bfa7-6e620ce7b49f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:35.576816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f53462-3619-4389-bfa7-6e620ce7b49f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:19:35.578518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f53462-3619-4389-bfa7-6e620ce7b49f service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:19:35.587668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 757/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:19:36.425599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7c2a9-7511-455a-be85-1ce72d0f51be None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:36.426058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7c2a9-7511-455a-be85-1ce72d0f51be None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:36.426165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7c2a9-7511-455a-be85-1ce72d0f51be None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:36.427578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:19:36.432333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc7db-2025-4467-8b93-430f0273df48 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:36.432758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc7db-2025-4467-8b93-430f0273df48 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:36.432900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc7db-2025-4467-8b93-430f0273df48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:36.452727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a04fc7db-2025-4467-8b93-430f0273df48 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:19:36.453907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a04fc7db-2025-4467-8b93-430f0273df48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:36.461558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:19:36.613249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7c2a9-7511-455a-be85-1ce72d0f51be None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:19:36.628162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7c2a9-7511-455a-be85-1ce72d0f51be None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:19:36.633479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698c9d-9659-4c01-b5c7-a7709e49f43b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:19:36.634066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698c9d-9659-4c01-b5c7-a7709e49f43b service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:36.634337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698c9d-9659-4c01-b5c7-a7709e49f43b service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:36.634601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698c9d-9659-4c01-b5c7-a7709e49f43b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:36.642629 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac698c9d-9659-4c01-b5c7-a7709e49f43b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:19:36.644204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac698c9d-9659-4c01-b5c7-a7709e49f43b service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:19:36.653519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 758/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:19:37.145305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf0a96-bea8-4c2d-a21c-e4a385e5df88 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:37.145586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf0a96-bea8-4c2d-a21c-e4a385e5df88 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:37.145858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf0a96-bea8-4c2d-a21c-e4a385e5df88 None None] PATH_INFO: `/v3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:37.147190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 759/1517] 10.222.0.30 () {54 vars in 925 bytes} [Tue Aug 9 12:19:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:19:37.163914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edc6e3-68e8-4340-87e9-6a6d7f77bfb9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:37.164220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edc6e3-68e8-4340-87e9-6a6d7f77bfb9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:37.164486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edc6e3-68e8-4340-87e9-6a6d7f77bfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:37.224081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-f4edc6e3-68e8-4340-87e9-6a6d7f77bfb9 None None] MFA Rules not processed for user `c7f2e22ace8648919104c910c74c1711`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:19:37.225305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f4edc6e3-68e8-4340-87e9-6a6d7f77bfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:37.242092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:19:37.296218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 759/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Aug 9 12:19:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:19:41.065664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58728c-fbc8-45fa-958b-100825c4b776 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:41.066169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58728c-fbc8-45fa-958b-100825c4b776 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:41.066169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58728c-fbc8-45fa-958b-100825c4b776 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:41.067535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 760/1519] 10.222.0.25 () {54 vars in 961 bytes} [Tue Aug 9 12:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:19:41.072528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fc729-f6a8-47e9-9aad-64853f41c09b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:41.072974 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fc729-f6a8-47e9-9aad-64853f41c09b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:41.073135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fc729-f6a8-47e9-9aad-64853f41c09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:41.092809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5c4fc729-f6a8-47e9-9aad-64853f41c09b None None] MFA Rules not processed for user `c7f2e22ace8648919104c910c74c1711`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:19:41.094075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5c4fc729-f6a8-47e9-9aad-64853f41c09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:41.102563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 760/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Aug 9 12:19:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:19:41.110531 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58728c-fbc8-45fa-958b-100825c4b776 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:19:41.124400 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58728c-fbc8-45fa-958b-100825c4b776 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:19:41.129936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40076547-84c3-49bf-acba-e8b428f44860 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:19:41.130524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076547-84c3-49bf-acba-e8b428f44860 service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:41.130799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076547-84c3-49bf-acba-e8b428f44860 service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:41.131067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076547-84c3-49bf-acba-e8b428f44860 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:41.139873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40076547-84c3-49bf-acba-e8b428f44860 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:19:41.141534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40076547-84c3-49bf-acba-e8b428f44860 service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:19:41.151193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 761/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:19:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:19:47.881806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd7de-8c36-482f-a713-f0972d446b48 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:47.882388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd7de-8c36-482f-a713-f0972d446b48 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:47.882388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd7de-8c36-482f-a713-f0972d446b48 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:47.883736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:19:47.888581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb454d14-9174-49c5-be96-7b24ed3c16da None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:47.889043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb454d14-9174-49c5-be96-7b24ed3c16da None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:47.889150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb454d14-9174-49c5-be96-7b24ed3c16da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:47.909765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bb454d14-9174-49c5-be96-7b24ed3c16da None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:19:47.910949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bb454d14-9174-49c5-be96-7b24ed3c16da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:47.918777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:19:48.071546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbd7de-8c36-482f-a713-f0972d446b48 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:19:48.086602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbd7de-8c36-482f-a713-f0972d446b48 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:19:48.091955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f2ee6-d54f-46bd-b593-21b1fcdc24cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:19:48.092545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f2ee6-d54f-46bd-b593-21b1fcdc24cc service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:48.092853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f2ee6-d54f-46bd-b593-21b1fcdc24cc service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:48.093125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f2ee6-d54f-46bd-b593-21b1fcdc24cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:48.101458 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f2ee6-d54f-46bd-b593-21b1fcdc24cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:19:48.103043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f2ee6-d54f-46bd-b593-21b1fcdc24cc service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:19:48.112680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 762/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:19:48.940714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa45f5-3df1-4f93-a8bf-68f9a75559b6 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:48.941263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa45f5-3df1-4f93-a8bf-68f9a75559b6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:48.941263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa45f5-3df1-4f93-a8bf-68f9a75559b6 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:48.942628 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:19:48.947304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033217f4-d06a-4214-bca9-89c5add4296a None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:48.947742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033217f4-d06a-4214-bca9-89c5add4296a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:48.947846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033217f4-d06a-4214-bca9-89c5add4296a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:48.966871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-033217f4-d06a-4214-bca9-89c5add4296a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:19:48.968056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-033217f4-d06a-4214-bca9-89c5add4296a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:48.976337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:19:49.125297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa45f5-3df1-4f93-a8bf-68f9a75559b6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:19:49.140002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa45f5-3df1-4f93-a8bf-68f9a75559b6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:19:49.146085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e3288-77e3-4a45-9080-18ce0ed973c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:19:49.146673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e3288-77e3-4a45-9080-18ce0ed973c1 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:49.146946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e3288-77e3-4a45-9080-18ce0ed973c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:49.147212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e3288-77e3-4a45-9080-18ce0ed973c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:49.155230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e3288-77e3-4a45-9080-18ce0ed973c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:19:49.157465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e3288-77e3-4a45-9080-18ce0ed973c1 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:19:49.167056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 764/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:19:53.097118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a50f5-f1ad-4887-b432-5159962c8d29 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:53.097691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a50f5-f1ad-4887-b432-5159962c8d29 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:53.097691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a50f5-f1ad-4887-b432-5159962c8d29 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:53.099020 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:19:53.104186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f00c-4fe0-4234-94ce-5b82c30c71d0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:53.104589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f00c-4fe0-4234-94ce-5b82c30c71d0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:53.104757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f00c-4fe0-4234-94ce-5b82c30c71d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:53.123803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-18d7f00c-4fe0-4234-94ce-5b82c30c71d0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:19:53.125158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-18d7f00c-4fe0-4234-94ce-5b82c30c71d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:53.133537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:19:53.206588 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a50f5-f1ad-4887-b432-5159962c8d29 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:19:53.208290 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a85a50f5-f1ad-4887-b432-5159962c8d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:53.286528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a50f5-f1ad-4887-b432-5159962c8d29 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:19:53.290111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e1f51-2722-4985-a144-ae820794d60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:19:53.290707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1f51-2722-4985-a144-ae820794d60e service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:53.290985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1f51-2722-4985-a144-ae820794d60e service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:53.291253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1f51-2722-4985-a144-ae820794d60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:53.300537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e1f51-2722-4985-a144-ae820794d60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:19:53.301992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e1f51-2722-4985-a144-ae820794d60e service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:19:53.311382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 765/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:19:55.305275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22d4a-acdb-4b72-93b6-a0f621285dfb None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:55.305842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22d4a-acdb-4b72-93b6-a0f621285dfb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:55.305842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22d4a-acdb-4b72-93b6-a0f621285dfb None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:55.307329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:19:55.312782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ded54-b5df-486e-9466-b1f99807cde8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:55.313262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ded54-b5df-486e-9466-b1f99807cde8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:55.313459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ded54-b5df-486e-9466-b1f99807cde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:55.332965 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-296ded54-b5df-486e-9466-b1f99807cde8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:19:55.334166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-296ded54-b5df-486e-9466-b1f99807cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:55.341994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:19:55.378483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22d4a-acdb-4b72-93b6-a0f621285dfb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:19:55.380164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3cb22d4a-acdb-4b72-93b6-a0f621285dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:55.393827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22d4a-acdb-4b72-93b6-a0f621285dfb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:19:55.397523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ba0ec-ee8b-47bd-b270-addb9171b9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:19:55.398122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba0ec-ee8b-47bd-b270-addb9171b9ff service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:55.398398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba0ec-ee8b-47bd-b270-addb9171b9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:55.398690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba0ec-ee8b-47bd-b270-addb9171b9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:55.408747 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ba0ec-ee8b-47bd-b270-addb9171b9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:19:55.410163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ba0ec-ee8b-47bd-b270-addb9171b9ff service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:19:55.420075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 767/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:19:58.780552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055250ad-2784-446c-a4ce-29d47dd9c9e5 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:58.781649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055250ad-2784-446c-a4ce-29d47dd9c9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:58.781649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055250ad-2784-446c-a4ce-29d47dd9c9e5 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:58.783110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:19:58.788157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0d2b-262d-4251-b9f2-3ed8cacd975f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:58.788590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0d2b-262d-4251-b9f2-3ed8cacd975f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:58.788796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0d2b-262d-4251-b9f2-3ed8cacd975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:58.808483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8cbb0d2b-262d-4251-b9f2-3ed8cacd975f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:19:58.809682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8cbb0d2b-262d-4251-b9f2-3ed8cacd975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:58.817449 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:19:59.126628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055250ad-2784-446c-a4ce-29d47dd9c9e5 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:19:59.128285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-055250ad-2784-446c-a4ce-29d47dd9c9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:59.195147 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:19:59.208917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055250ad-2784-446c-a4ce-29d47dd9c9e5 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:19:59.212420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b038450-6379-4890-83fd-fb6952d925fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:19:59.213053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b038450-6379-4890-83fd-fb6952d925fe service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:59.213330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b038450-6379-4890-83fd-fb6952d925fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:59.213598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b038450-6379-4890-83fd-fb6952d925fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:59.222958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b038450-6379-4890-83fd-fb6952d925fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:19:59.224385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b038450-6379-4890-83fd-fb6952d925fe service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:19:59.233615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 768/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:20:01.233711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a63fc9-5c4d-4599-a68d-b81f54356d05 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:01.234813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a63fc9-5c4d-4599-a68d-b81f54356d05 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:01.234813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a63fc9-5c4d-4599-a68d-b81f54356d05 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:01.236110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:20:01.241382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1131ac-bb5f-402c-88dd-59ad1775ee96 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:01.241786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1131ac-bb5f-402c-88dd-59ad1775ee96 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:01.241929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1131ac-bb5f-402c-88dd-59ad1775ee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:01.261348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ab1131ac-bb5f-402c-88dd-59ad1775ee96 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:20:01.262528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ab1131ac-bb5f-402c-88dd-59ad1775ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:01.270329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:20:01.572819 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a63fc9-5c4d-4599-a68d-b81f54356d05 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:20:01.574777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-94a63fc9-5c4d-4599-a68d-b81f54356d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:01.588140 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a63fc9-5c4d-4599-a68d-b81f54356d05 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:20:01.591560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260ab39-eff0-41ce-9aa1-3f6dc11c4140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:20:01.592137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260ab39-eff0-41ce-9aa1-3f6dc11c4140 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:01.592410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260ab39-eff0-41ce-9aa1-3f6dc11c4140 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:01.592707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260ab39-eff0-41ce-9aa1-3f6dc11c4140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:01.602376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260ab39-eff0-41ce-9aa1-3f6dc11c4140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:20:01.603780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260ab39-eff0-41ce-9aa1-3f6dc11c4140 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:20:01.613918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 770/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:20:11.256254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=11 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:20:11.609512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:26.652502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99658-4c6d-4964-b9d5-121921d7b2d6 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:26.653939 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99658-4c6d-4964-b9d5-121921d7b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:26.654479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99658-4c6d-4964-b9d5-121921d7b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:26.680778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-feb99658-4c6d-4964-b9d5-121921d7b2d6 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:26.682348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-feb99658-4c6d-4964-b9d5-121921d7b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:26.695036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 770/1540] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:26.705115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbafb1-9954-459e-83d6-ec99ef4d2fd4 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:26.705698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbafb1-9954-459e-83d6-ec99ef4d2fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:26.705698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbafb1-9954-459e-83d6-ec99ef4d2fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:26.718087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f8b32-0c2f-4cc8-b736-472f0ce50d07 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:26.725968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f8b32-0c2f-4cc8-b736-472f0ce50d07 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:26.726619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f8b32-0c2f-4cc8-b736-472f0ce50d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:26.741653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d0cbafb1-9954-459e-83d6-ec99ef4d2fd4 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:26.743108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d0cbafb1-9954-459e-83d6-ec99ef4d2fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:26.758415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 771/1541] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:26.764272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbafb1-9954-459e-83d6-ec99ef4d2fd4 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:26.778995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbafb1-9954-459e-83d6-ec99ef4d2fd4 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:26.780641 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-8a1f8b32-0c2f-4cc8-b736-472f0ce50d07 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:26.782164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8a1f8b32-0c2f-4cc8-b736-472f0ce50d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:26.789525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b52fd9-b54e-4941-844e-9ab1e7c39161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:26.790160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b52fd9-b54e-4941-844e-9ab1e7c39161 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:26.790441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b52fd9-b54e-4941-844e-9ab1e7c39161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:26.790717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b52fd9-b54e-4941-844e-9ab1e7c39161 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:26.791375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b52fd9-b54e-4941-844e-9ab1e7c39161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:26.791675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b52fd9-b54e-4941-844e-9ab1e7c39161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:26.792726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: WARNING py.warnings [None req-e8b52fd9-b54e-4941-844e-9ab1e7c39161 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:21:26.792726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: warnings.warn(msg) Aug 09 12:21:26.792726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: Aug 09 12:21:26.794481 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b52fd9-b54e-4941-844e-9ab1e7c39161 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:26.800315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 771/1542] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:21:26.802433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd193fe2-8a4f-4e5b-af4b-ec23c70073d3 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:26.803000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd193fe2-8a4f-4e5b-af4b-ec23c70073d3 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:26.803494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd193fe2-8a4f-4e5b-af4b-ec23c70073d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:26.820448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 772/1543] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:21:26.821924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509c340-99eb-4616-8df9-638f818720e2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:26.822211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509c340-99eb-4616-8df9-638f818720e2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:26.822479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509c340-99eb-4616-8df9-638f818720e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:26.849687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-fd193fe2-8a4f-4e5b-af4b-ec23c70073d3 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:26.851299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-fd193fe2-8a4f-4e5b-af4b-ec23c70073d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:26.862274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5509c340-99eb-4616-8df9-638f818720e2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:26.863455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5509c340-99eb-4616-8df9-638f818720e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:26.867466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 772/1544] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:26.873592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd193fe2-8a4f-4e5b-af4b-ec23c70073d3 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:26.885838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 773/1545] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:26.890564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92d56-35f1-45b2-a994-1c8032f20a10 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:26.890850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92d56-35f1-45b2-a994-1c8032f20a10 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:26.892312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92d56-35f1-45b2-a994-1c8032f20a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:26.897343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd193fe2-8a4f-4e5b-af4b-ec23c70073d3 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:26.905762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd20110-dacb-439c-acf4-ac63a8cb7dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:26.906306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20110-dacb-439c-acf4-ac63a8cb7dda admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:26.906584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20110-dacb-439c-acf4-ac63a8cb7dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:26.906842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20110-dacb-439c-acf4-ac63a8cb7dda admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:26.907460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd20110-dacb-439c-acf4-ac63a8cb7dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:26.908477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WARNING py.warnings [None req-0fd20110-dacb-439c-acf4-ac63a8cb7dda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:21:26.908477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: warnings.warn(msg) Aug 09 12:21:26.908477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: Aug 09 12:21:26.909688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd20110-dacb-439c-acf4-ac63a8cb7dda admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:26.932643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-daa92d56-35f1-45b2-a994-1c8032f20a10 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:26.933885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-daa92d56-35f1-45b2-a994-1c8032f20a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:26.954347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 774/1546] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:26.955758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9b2c4-97cd-4391-990a-f3e2c410d9f4 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:26.956038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9b2c4-97cd-4391-990a-f3e2c410d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:26.956301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9b2c4-97cd-4391-990a-f3e2c410d9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:26.988871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7bd9b2c4-97cd-4391-990a-f3e2c410d9f4 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:26.990141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7bd9b2c4-97cd-4391-990a-f3e2c410d9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:26.994510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 773/1547] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:26 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:26.995981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd20110-dacb-439c-acf4-ac63a8cb7dda admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.006101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 775/1548] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:27.007916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb7fa9-246b-4f5e-a8a2-6629883c545b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.015964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb7fa9-246b-4f5e-a8a2-6629883c545b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.016507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb7fa9-246b-4f5e-a8a2-6629883c545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.038822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-dfdb7fa9-246b-4f5e-a8a2-6629883c545b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:27.040126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dfdb7fa9-246b-4f5e-a8a2-6629883c545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:27.077956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd20110-dacb-439c-acf4-ac63a8cb7dda admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.083485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123b747-bd31-44d1-9fb6-0237d204cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.084399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b747-bd31-44d1-9fb6-0237d204cb54 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.084845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b747-bd31-44d1-9fb6-0237d204cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.085282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b747-bd31-44d1-9fb6-0237d204cb54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.085928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123b747-bd31-44d1-9fb6-0237d204cb54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:27.086368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123b747-bd31-44d1-9fb6-0237d204cb54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.088307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123b747-bd31-44d1-9fb6-0237d204cb54 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.106766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 774/1549] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:27.106991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 776/1550] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:27.106991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2a488-35b1-41cc-8b24-1fb20231eef0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.106991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2a488-35b1-41cc-8b24-1fb20231eef0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.106991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2a488-35b1-41cc-8b24-1fb20231eef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.107346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730541f7-f53b-4b4d-98bb-1da5c803b0e5 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.107346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730541f7-f53b-4b4d-98bb-1da5c803b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.107346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730541f7-f53b-4b4d-98bb-1da5c803b0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.127779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-36a2a488-35b1-41cc-8b24-1fb20231eef0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:27.129169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-36a2a488-35b1-41cc-8b24-1fb20231eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:27.132559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-730541f7-f53b-4b4d-98bb-1da5c803b0e5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:27.133842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-730541f7-f53b-4b4d-98bb-1da5c803b0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:27.138541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 777/1551] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:27.139401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2a488-35b1-41cc-8b24-1fb20231eef0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.147253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 775/1552] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:27.148859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a9124-9599-4396-815e-5a098c85fba9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.149247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a9124-9599-4396-815e-5a098c85fba9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.149570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a9124-9599-4396-815e-5a098c85fba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.152588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2a488-35b1-41cc-8b24-1fb20231eef0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.157320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5fe05-f900-4c05-96db-55edafffcef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.158020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5fe05-f900-4c05-96db-55edafffcef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.158304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5fe05-f900-4c05-96db-55edafffcef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.158575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5fe05-f900-4c05-96db-55edafffcef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.159196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5fe05-f900-4c05-96db-55edafffcef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.160336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: WARNING py.warnings [None req-f9a5fe05-f900-4c05-96db-55edafffcef5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:21:27.160336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: warnings.warn(msg) Aug 09 12:21:27.160336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: Aug 09 12:21:27.161603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5fe05-f900-4c05-96db-55edafffcef5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.169363 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-533a9124-9599-4396-815e-5a098c85fba9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:27.170542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-533a9124-9599-4396-815e-5a098c85fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:27.179253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 776/1553] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:27.180474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfd2c-9337-4d23-9e00-b00d41b8c05b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.180774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfd2c-9337-4d23-9e00-b00d41b8c05b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.181154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfd2c-9337-4d23-9e00-b00d41b8c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.184885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 778/1554] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.185999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5fe05-f900-4c05-96db-55edafffcef5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.195679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5fe05-f900-4c05-96db-55edafffcef5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.201155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba5b2e-560a-4d86-aa65-315f8b03ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.201993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba5b2e-560a-4d86-aa65-315f8b03ea10 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.202272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba5b2e-560a-4d86-aa65-315f8b03ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.202537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba5b2e-560a-4d86-aa65-315f8b03ea10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.203168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba5b2e-560a-4d86-aa65-315f8b03ea10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:27.203466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba5b2e-560a-4d86-aa65-315f8b03ea10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.204771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-7f6cfd2c-9337-4d23-9e00-b00d41b8c05b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:27.205083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba5b2e-560a-4d86-aa65-315f8b03ea10 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.205974 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-7f6cfd2c-9337-4d23-9e00-b00d41b8c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:27.213700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 777/1555] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:27.216849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cfd2c-9337-4d23-9e00-b00d41b8c05b None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.224038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 779/1556] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:27.224038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bc722-5f71-49cf-b216-ea03a3c94b0e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.224038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bc722-5f71-49cf-b216-ea03a3c94b0e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.224038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bc722-5f71-49cf-b216-ea03a3c94b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.226917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cfd2c-9337-4d23-9e00-b00d41b8c05b None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.231691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a9f1b-6aa8-454f-80ec-6406e9a8bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.232367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a9f1b-6aa8-454f-80ec-6406e9a8bbfa admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.232672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a9f1b-6aa8-454f-80ec-6406e9a8bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.232944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a9f1b-6aa8-454f-80ec-6406e9a8bbfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.233589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a9f1b-6aa8-454f-80ec-6406e9a8bbfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.235480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a9f1b-6aa8-454f-80ec-6406e9a8bbfa admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.239966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-161bc722-5f71-49cf-b216-ea03a3c94b0e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:27.241195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-161bc722-5f71-49cf-b216-ea03a3c94b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:27.249631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 780/1557] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:27.250823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30f98-1b2b-407b-8ca5-8591f7442baf None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.251120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30f98-1b2b-407b-8ca5-8591f7442baf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.251378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30f98-1b2b-407b-8ca5-8591f7442baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.264844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 778/1558] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.266055 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a9f1b-6aa8-454f-80ec-6406e9a8bbfa admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.274614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4ca30f98-1b2b-407b-8ca5-8591f7442baf None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:27.275810 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4ca30f98-1b2b-407b-8ca5-8591f7442baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:27.328538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a9f1b-6aa8-454f-80ec-6406e9a8bbfa admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.333074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d20c8-3f82-4291-9ac9-bc6fcb56773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.333667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d20c8-3f82-4291-9ac9-bc6fcb56773f admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.333941 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d20c8-3f82-4291-9ac9-bc6fcb56773f admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.334206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d20c8-3f82-4291-9ac9-bc6fcb56773f admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.334872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d20c8-3f82-4291-9ac9-bc6fcb56773f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:27.335018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 781/1559] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:27.335193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d20c8-3f82-4291-9ac9-bc6fcb56773f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.335715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30f98-1b2b-407b-8ca5-8591f7442baf None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.336877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d20c8-3f82-4291-9ac9-bc6fcb56773f admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.339725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:27.344979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30f98-1b2b-407b-8ca5-8591f7442baf None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.349801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84877e49-b7b0-4973-b5ce-8e44a6f92b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.357286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 779/1560] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:27.357471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877e49-b7b0-4973-b5ce-8e44a6f92b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.357471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877e49-b7b0-4973-b5ce-8e44a6f92b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.357471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877e49-b7b0-4973-b5ce-8e44a6f92b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.357761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d20c8-3f82-4291-9ac9-bc6fcb56773f admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.357864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84877e49-b7b0-4973-b5ce-8e44a6f92b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:27.357864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84877e49-b7b0-4973-b5ce-8e44a6f92b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.357864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84877e49-b7b0-4973-b5ce-8e44a6f92b33 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.361340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d20c8-3f82-4291-9ac9-bc6fcb56773f admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.366087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c4740-f915-4bdb-ba04-d6b8b2057a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.366678 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c4740-f915-4bdb-ba04-d6b8b2057a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.366955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c4740-f915-4bdb-ba04-d6b8b2057a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.367225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c4740-f915-4bdb-ba04-d6b8b2057a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.367857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c4740-f915-4bdb-ba04-d6b8b2057a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.369229 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 782/1561] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:27.369474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c4740-f915-4bdb-ba04-d6b8b2057a63 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.370476 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2febe-107d-45d4-9f7e-e205fcf29a62 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.370754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2febe-107d-45d4-9f7e-e205fcf29a62 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.371018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2febe-107d-45d4-9f7e-e205fcf29a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.379780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:27.382218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 780/1562] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:27.383020 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c4740-f915-4bdb-ba04-d6b8b2057a63 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.393584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c4740-f915-4bdb-ba04-d6b8b2057a63 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.394888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8bd2febe-107d-45d4-9f7e-e205fcf29a62 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:27.396088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8bd2febe-107d-45d4-9f7e-e205fcf29a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:27.398260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634427c2-037a-4e6d-9e22-a436576270ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.399483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634427c2-037a-4e6d-9e22-a436576270ed admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.399763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634427c2-037a-4e6d-9e22-a436576270ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.400037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634427c2-037a-4e6d-9e22-a436576270ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.400679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634427c2-037a-4e6d-9e22-a436576270ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.402614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634427c2-037a-4e6d-9e22-a436576270ed admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.404552 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 783/1563] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:27.405772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2effdec-c37d-4a4f-980d-b4da3cd18614 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.406050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2effdec-c37d-4a4f-980d-b4da3cd18614 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.406317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2effdec-c37d-4a4f-980d-b4da3cd18614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.428813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e2effdec-c37d-4a4f-980d-b4da3cd18614 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:27.431017 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e2effdec-c37d-4a4f-980d-b4da3cd18614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:27.435271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 781/1564] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.436224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634427c2-037a-4e6d-9e22-a436576270ed admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.495998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 784/1565] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:27.496660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634427c2-037a-4e6d-9e22-a436576270ed admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.497606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2effdec-c37d-4a4f-980d-b4da3cd18614 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.504446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053366d-d1e7-4d0c-a370-fdba07503e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.505082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053366d-d1e7-4d0c-a370-fdba07503e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.505459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053366d-d1e7-4d0c-a370-fdba07503e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.505620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053366d-d1e7-4d0c-a370-fdba07503e1d admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.506469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053366d-d1e7-4d0c-a370-fdba07503e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.507165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2effdec-c37d-4a4f-980d-b4da3cd18614 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.508492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053366d-d1e7-4d0c-a370-fdba07503e1d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.511738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8580c03-93fc-4774-b04d-b2ca170940d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.512327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8580c03-93fc-4774-b04d-b2ca170940d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.512751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8580c03-93fc-4774-b04d-b2ca170940d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.513143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8580c03-93fc-4774-b04d-b2ca170940d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.513789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8580c03-93fc-4774-b04d-b2ca170940d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:27.514088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8580c03-93fc-4774-b04d-b2ca170940d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.515669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8580c03-93fc-4774-b04d-b2ca170940d6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.528407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 785/1566] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:27.529350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8580c03-93fc-4774-b04d-b2ca170940d6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.533311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 782/1567] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.533311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053366d-d1e7-4d0c-a370-fdba07503e1d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.540551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8580c03-93fc-4774-b04d-b2ca170940d6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.545885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053366d-d1e7-4d0c-a370-fdba07503e1d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.546161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb995e07-2243-4f74-b4f1-02b38ff2cc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.546752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb995e07-2243-4f74-b4f1-02b38ff2cc8f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.547027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb995e07-2243-4f74-b4f1-02b38ff2cc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.547300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb995e07-2243-4f74-b4f1-02b38ff2cc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.547912 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb995e07-2243-4f74-b4f1-02b38ff2cc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.549856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb995e07-2243-4f74-b4f1-02b38ff2cc8f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.550597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fff5b-03f0-49d6-a90e-f3636e62699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.551441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fff5b-03f0-49d6-a90e-f3636e62699f admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.551721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fff5b-03f0-49d6-a90e-f3636e62699f admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.551988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fff5b-03f0-49d6-a90e-f3636e62699f admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.552600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fff5b-03f0-49d6-a90e-f3636e62699f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.554525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fff5b-03f0-49d6-a90e-f3636e62699f admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.578744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 786/1568] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.579767 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb995e07-2243-4f74-b4f1-02b38ff2cc8f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.585608 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 783/1569] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.585608 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fff5b-03f0-49d6-a90e-f3636e62699f admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.643189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb995e07-2243-4f74-b4f1-02b38ff2cc8f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.647746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec6a2-592e-4f8f-bffd-294daf42c393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.648394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec6a2-592e-4f8f-bffd-294daf42c393 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.648700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec6a2-592e-4f8f-bffd-294daf42c393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.648976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec6a2-592e-4f8f-bffd-294daf42c393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.649608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cec6a2-592e-4f8f-bffd-294daf42c393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.649864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fff5b-03f0-49d6-a90e-f3636e62699f admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.651187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cec6a2-592e-4f8f-bffd-294daf42c393 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.655090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4799aad-93fc-45f7-87df-5dcf937151ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.655699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4799aad-93fc-45f7-87df-5dcf937151ad admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.655976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4799aad-93fc-45f7-87df-5dcf937151ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.656249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4799aad-93fc-45f7-87df-5dcf937151ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.657136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4799aad-93fc-45f7-87df-5dcf937151ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:27.657470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4799aad-93fc-45f7-87df-5dcf937151ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.659097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4799aad-93fc-45f7-87df-5dcf937151ad admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.661544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 787/1570] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:27.662860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec6a2-592e-4f8f-bffd-294daf42c393 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.679207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 784/1571] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:27.679207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4799aad-93fc-45f7-87df-5dcf937151ad admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.679487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec6a2-592e-4f8f-bffd-294daf42c393 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.679487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3c353-f1b3-4d4f-b759-3ffb994e5e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.679487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c353-f1b3-4d4f-b759-3ffb994e5e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.679487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c353-f1b3-4d4f-b759-3ffb994e5e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.679872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c353-f1b3-4d4f-b759-3ffb994e5e43 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.679872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3c353-f1b3-4d4f-b759-3ffb994e5e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.681343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3c353-f1b3-4d4f-b759-3ffb994e5e43 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.685884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4799aad-93fc-45f7-87df-5dcf937151ad admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.690612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccfe49-a9ff-4551-9502-2bb5fcf31cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.691199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccfe49-a9ff-4551-9502-2bb5fcf31cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.691478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccfe49-a9ff-4551-9502-2bb5fcf31cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.691748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccfe49-a9ff-4551-9502-2bb5fcf31cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.692374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccfe49-a9ff-4551-9502-2bb5fcf31cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:27.692708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccfe49-a9ff-4551-9502-2bb5fcf31cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.694308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccfe49-a9ff-4551-9502-2bb5fcf31cc2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.703163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 788/1572] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.703976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3c353-f1b3-4d4f-b759-3ffb994e5e43 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.708664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 785/1573] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:27.708664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccfe49-a9ff-4551-9502-2bb5fcf31cc2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.716039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3c353-f1b3-4d4f-b759-3ffb994e5e43 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.718512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccfe49-a9ff-4551-9502-2bb5fcf31cc2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.720821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c5161-1f33-4c74-87db-05c075e997b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.721420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5161-1f33-4c74-87db-05c075e997b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.721697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5161-1f33-4c74-87db-05c075e997b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.721966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5161-1f33-4c74-87db-05c075e997b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.722597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c5161-1f33-4c74-87db-05c075e997b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.723631 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01721552-3780-4e65-9685-26caa054de12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.724284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c5161-1f33-4c74-87db-05c075e997b8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.724445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01721552-3780-4e65-9685-26caa054de12 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.724552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01721552-3780-4e65-9685-26caa054de12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.724788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01721552-3780-4e65-9685-26caa054de12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.725392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01721552-3780-4e65-9685-26caa054de12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.727301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01721552-3780-4e65-9685-26caa054de12 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.735717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 789/1574] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:27.736615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c5161-1f33-4c74-87db-05c075e997b8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.737670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:27.747462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c5161-1f33-4c74-87db-05c075e997b8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.752497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d9668-4e92-4633-9681-16f5d2500aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.753119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d9668-4e92-4633-9681-16f5d2500aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.753399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d9668-4e92-4633-9681-16f5d2500aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.753668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d9668-4e92-4633-9681-16f5d2500aaf admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.754286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d9668-4e92-4633-9681-16f5d2500aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.756212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d9668-4e92-4633-9681-16f5d2500aaf admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.758618 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 786/1575] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.759404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01721552-3780-4e65-9685-26caa054de12 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.784428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 790/1576] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.784428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d9668-4e92-4633-9681-16f5d2500aaf admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.791935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d9668-4e92-4633-9681-16f5d2500aaf admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.802139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:27.829296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01721552-3780-4e65-9685-26caa054de12 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.834436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d69fcc-2cbe-4415-bf96-f807aeede5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.835038 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d69fcc-2cbe-4415-bf96-f807aeede5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.835315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d69fcc-2cbe-4415-bf96-f807aeede5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.835585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d69fcc-2cbe-4415-bf96-f807aeede5e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.836198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d69fcc-2cbe-4415-bf96-f807aeede5e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.838203 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d69fcc-2cbe-4415-bf96-f807aeede5e7 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.851857 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28489c3b-7c6e-452b-850c-2c9f9894985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.852585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28489c3b-7c6e-452b-850c-2c9f9894985d admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.852817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28489c3b-7c6e-452b-850c-2c9f9894985d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.853087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28489c3b-7c6e-452b-850c-2c9f9894985d admin admin] PATH_INFO: `/v3/projects/6848f49a6a854f828a851ec42b649ec1/users/646ce2a5be91485a9f785e7f41a3e9ab/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.860653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 787/1577] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.861634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d69fcc-2cbe-4415-bf96-f807aeede5e7 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.868386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28489c3b-7c6e-452b-850c-2c9f9894985d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6848f49a6a854f828a851ec42b649ec1, user_id=646ce2a5be91485a9f785e7f41a3e9ab, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.871067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28489c3b-7c6e-452b-850c-2c9f9894985d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.871823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d69fcc-2cbe-4415-bf96-f807aeede5e7 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.877727 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f205c04-994a-48fa-84a1-4eeed2a99a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.878324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f205c04-994a-48fa-84a1-4eeed2a99a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.878697 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f205c04-994a-48fa-84a1-4eeed2a99a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.879007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f205c04-994a-48fa-84a1-4eeed2a99a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.879608 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f205c04-994a-48fa-84a1-4eeed2a99a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.881531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f205c04-994a-48fa-84a1-4eeed2a99a8f admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:27.884205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 791/1578] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:27 2022] PUT /identity/v3/projects/6848f49a6a854f828a851ec42b649ec1/users/646ce2a5be91485a9f785e7f41a3e9ab/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:27.888997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28489c3b-7c6e-452b-850c-2c9f9894985d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.910711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 788/1579] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:27.911638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f205c04-994a-48fa-84a1-4eeed2a99a8f admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:27.950308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28489c3b-7c6e-452b-850c-2c9f9894985d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.973600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f205c04-994a-48fa-84a1-4eeed2a99a8f admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:27.978472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa526-fa42-4693-8345-4c66c73844a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:27.979068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa526-fa42-4693-8345-4c66c73844a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:27.979340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa526-fa42-4693-8345-4c66c73844a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:27.979610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa526-fa42-4693-8345-4c66c73844a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:27.980218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa526-fa42-4693-8345-4c66c73844a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:27.982761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa526-fa42-4693-8345-4c66c73844a4 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.007287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c19e63-4e8d-42d3-bde8-4137b0193c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.007898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c19e63-4e8d-42d3-bde8-4137b0193c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.008175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c19e63-4e8d-42d3-bde8-4137b0193c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.008441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c19e63-4e8d-42d3-bde8-4137b0193c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.009110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c19e63-4e8d-42d3-bde8-4137b0193c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.012677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 789/1580] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:27 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:28.012822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c19e63-4e8d-42d3-bde8-4137b0193c2c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.012940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa526-fa42-4693-8345-4c66c73844a4 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.024350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 792/1581] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.024350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c19e63-4e8d-42d3-bde8-4137b0193c2c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.032094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c19e63-4e8d-42d3-bde8-4137b0193c2c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.058916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:28.070170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:28.077549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa526-fa42-4693-8345-4c66c73844a4 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.082197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f728-a1d6-4c1b-a7d9-1f0437729ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.082806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f728-a1d6-4c1b-a7d9-1f0437729ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.083084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f728-a1d6-4c1b-a7d9-1f0437729ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.083357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f728-a1d6-4c1b-a7d9-1f0437729ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.083995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956f728-a1d6-4c1b-a7d9-1f0437729ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.085696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956f728-a1d6-4c1b-a7d9-1f0437729ebe admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.089235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5af5-3596-4215-ac72-67bf1498292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.089834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5af5-3596-4215-ac72-67bf1498292f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.090109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5af5-3596-4215-ac72-67bf1498292f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.090376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5af5-3596-4215-ac72-67bf1498292f admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.091531 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a5af5-3596-4215-ac72-67bf1498292f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.093484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a5af5-3596-4215-ac72-67bf1498292f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.096003 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 790/1582] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.096809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f728-a1d6-4c1b-a7d9-1f0437729ebe admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.106875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f728-a1d6-4c1b-a7d9-1f0437729ebe admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.112146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755daa6-1118-4229-a4e6-806ce71b2d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.112770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755daa6-1118-4229-a4e6-806ce71b2d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.113048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755daa6-1118-4229-a4e6-806ce71b2d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.113318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755daa6-1118-4229-a4e6-806ce71b2d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.113940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755daa6-1118-4229-a4e6-806ce71b2d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.115723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755daa6-1118-4229-a4e6-806ce71b2d32 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.115854 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 793/1583] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:28 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:28.117005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5af5-3596-4215-ac72-67bf1498292f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.129507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 791/1584] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.129673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5af5-3596-4215-ac72-67bf1498292f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.129787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531f6e-dd21-4c25-90e8-c4d53bb27c4f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.129787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531f6e-dd21-4c25-90e8-c4d53bb27c4f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.129787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531f6e-dd21-4c25-90e8-c4d53bb27c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.132044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d20b0-3139-453b-aa3d-0d7af8aaa93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.132641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d20b0-3139-453b-aa3d-0d7af8aaa93f admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.132937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d20b0-3139-453b-aa3d-0d7af8aaa93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.133205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d20b0-3139-453b-aa3d-0d7af8aaa93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.133831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d20b0-3139-453b-aa3d-0d7af8aaa93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.135395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d20b0-3139-453b-aa3d-0d7af8aaa93f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.147103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 794/1585] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.148043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d20b0-3139-453b-aa3d-0d7af8aaa93f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.149823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a7531f6e-dd21-4c25-90e8-c4d53bb27c4f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:28.151121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a7531f6e-dd21-4c25-90e8-c4d53bb27c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:28.158619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d20b0-3139-453b-aa3d-0d7af8aaa93f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.159565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 792/1586] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:28.160170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7531f6e-dd21-4c25-90e8-c4d53bb27c4f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.166301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47208075-cae3-436f-a9d2-b99ee0bb0375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.166893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47208075-cae3-436f-a9d2-b99ee0bb0375 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.167167 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47208075-cae3-436f-a9d2-b99ee0bb0375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.167436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47208075-cae3-436f-a9d2-b99ee0bb0375 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.168047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47208075-cae3-436f-a9d2-b99ee0bb0375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.170223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47208075-cae3-436f-a9d2-b99ee0bb0375 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.171305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7531f6e-dd21-4c25-90e8-c4d53bb27c4f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.176143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af451c-05f3-4529-b2c9-bc722260e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.176801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af451c-05f3-4529-b2c9-bc722260e09b admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.177080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af451c-05f3-4529-b2c9-bc722260e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.177352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af451c-05f3-4529-b2c9-bc722260e09b admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.177966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af451c-05f3-4529-b2c9-bc722260e09b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.179879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af451c-05f3-4529-b2c9-bc722260e09b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.194916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 795/1587] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:28 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:28.196045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47208075-cae3-436f-a9d2-b99ee0bb0375 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.202970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 793/1588] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:28 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:28.205578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af451c-05f3-4529-b2c9-bc722260e09b admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.207371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47208075-cae3-436f-a9d2-b99ee0bb0375 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.212335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5837b1-19bb-4a1f-9968-659d039a4679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.212970 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5837b1-19bb-4a1f-9968-659d039a4679 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.213253 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5837b1-19bb-4a1f-9968-659d039a4679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.213523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5837b1-19bb-4a1f-9968-659d039a4679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.214163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5837b1-19bb-4a1f-9968-659d039a4679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.215440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af451c-05f3-4529-b2c9-bc722260e09b admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.216356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5837b1-19bb-4a1f-9968-659d039a4679 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.220615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17653b-aa03-4fab-85cb-8aa232f79aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.221288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17653b-aa03-4fab-85cb-8aa232f79aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.222017 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17653b-aa03-4fab-85cb-8aa232f79aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.222017 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17653b-aa03-4fab-85cb-8aa232f79aea admin admin] PATH_INFO: `/v3/projects/51d5996d1e77474e9468e1316c838830/users/fcedc1966e19490fb739046a3379b135/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.230056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 796/1589] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.230056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5837b1-19bb-4a1f-9968-659d039a4679 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.238926 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17653b-aa03-4fab-85cb-8aa232f79aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d5996d1e77474e9468e1316c838830, user_id=fcedc1966e19490fb739046a3379b135, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.239627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5837b1-19bb-4a1f-9968-659d039a4679 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.239977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WARNING py.warnings [None req-ff17653b-aa03-4fab-85cb-8aa232f79aea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:21:28.239977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: warnings.warn(msg) Aug 09 12:21:28.239977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: Aug 09 12:21:28.241940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17653b-aa03-4fab-85cb-8aa232f79aea admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.244259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31305f-b4e6-4d56-bded-05c7e1acd299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.244877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31305f-b4e6-4d56-bded-05c7e1acd299 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.245163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31305f-b4e6-4d56-bded-05c7e1acd299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.245426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31305f-b4e6-4d56-bded-05c7e1acd299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.246086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31305f-b4e6-4d56-bded-05c7e1acd299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.248383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31305f-b4e6-4d56-bded-05c7e1acd299 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.255667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 794/1590] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:28 2022] PUT /identity/v3/projects/51d5996d1e77474e9468e1316c838830/users/fcedc1966e19490fb739046a3379b135/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:28.256467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17653b-aa03-4fab-85cb-8aa232f79aea admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.259355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 797/1591] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.260083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31305f-b4e6-4d56-bded-05c7e1acd299 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.269480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31305f-b4e6-4d56-bded-05c7e1acd299 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.322060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17653b-aa03-4fab-85cb-8aa232f79aea admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.326928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdf09d-37b3-4fae-8dd4-e41c42d614de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.327501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414899f8-0ac4-40fb-8fe1-eb47b361291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.327630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdf09d-37b3-4fae-8dd4-e41c42d614de admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.327792 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdf09d-37b3-4fae-8dd4-e41c42d614de admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.328062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdf09d-37b3-4fae-8dd4-e41c42d614de admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.328166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414899f8-0ac4-40fb-8fe1-eb47b361291e admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.328374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414899f8-0ac4-40fb-8fe1-eb47b361291e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.328670 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414899f8-0ac4-40fb-8fe1-eb47b361291e admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.328788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdf09d-37b3-4fae-8dd4-e41c42d614de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.329439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414899f8-0ac4-40fb-8fe1-eb47b361291e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.330309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdf09d-37b3-4fae-8dd4-e41c42d614de admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.331013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414899f8-0ac4-40fb-8fe1-eb47b361291e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.340161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 795/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.344315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 798/1593] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.344478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdf09d-37b3-4fae-8dd4-e41c42d614de admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.344582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414899f8-0ac4-40fb-8fe1-eb47b361291e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.352845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414899f8-0ac4-40fb-8fe1-eb47b361291e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.358173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ee703-169e-409b-9f0b-83915b896af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.358755 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee703-169e-409b-9f0b-83915b896af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.359033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee703-169e-409b-9f0b-83915b896af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.359300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee703-169e-409b-9f0b-83915b896af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.359922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ee703-169e-409b-9f0b-83915b896af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.361601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ee703-169e-409b-9f0b-83915b896af8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.371532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 799/1594] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.372762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ee703-169e-409b-9f0b-83915b896af8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.383661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ee703-169e-409b-9f0b-83915b896af8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.388673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89bbcc-407e-4422-9134-59b4ada3d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.389348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89bbcc-407e-4422-9134-59b4ada3d4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.389538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89bbcc-407e-4422-9134-59b4ada3d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.389809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89bbcc-407e-4422-9134-59b4ada3d4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.390459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89bbcc-407e-4422-9134-59b4ada3d4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.392025 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89bbcc-407e-4422-9134-59b4ada3d4b5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.400135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdf09d-37b3-4fae-8dd4-e41c42d614de admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.403049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 800/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.403906 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89bbcc-407e-4422-9134-59b4ada3d4b5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.404031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05e0ee-b26d-49f6-b28b-3e44030e1dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.404611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e0ee-b26d-49f6-b28b-3e44030e1dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.404918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e0ee-b26d-49f6-b28b-3e44030e1dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.405189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e0ee-b26d-49f6-b28b-3e44030e1dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.414795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05e0ee-b26d-49f6-b28b-3e44030e1dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.415464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89bbcc-407e-4422-9134-59b4ada3d4b5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.416380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05e0ee-b26d-49f6-b28b-3e44030e1dd4 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.421053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f9a64-c43d-4d3e-8e3d-0e01541d05b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.421556 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f9a64-c43d-4d3e-8e3d-0e01541d05b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.421837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f9a64-c43d-4d3e-8e3d-0e01541d05b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.422113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f9a64-c43d-4d3e-8e3d-0e01541d05b6 admin admin] PATH_INFO: `/v3/projects/5a5f5e9b58c84670855dce1b943514e0/users/79fa6a6d279c4ed88f26062adfe2d3c6/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.427164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 796/1596] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:28.428450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a39c-a85e-4de2-95fb-f19d17fbe996 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.428894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a39c-a85e-4de2-95fb-f19d17fbe996 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.429225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a39c-a85e-4de2-95fb-f19d17fbe996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.439118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f9a64-c43d-4d3e-8e3d-0e01541d05b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5f5e9b58c84670855dce1b943514e0, user_id=79fa6a6d279c4ed88f26062adfe2d3c6, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.441842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f9a64-c43d-4d3e-8e3d-0e01541d05b6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.450047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-3096a39c-a85e-4de2-95fb-f19d17fbe996 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:28.451547 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3096a39c-a85e-4de2-95fb-f19d17fbe996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:28.470642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 801/1597] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:28 2022] PUT /identity/v3/projects/5a5f5e9b58c84670855dce1b943514e0/users/79fa6a6d279c4ed88f26062adfe2d3c6/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:28.470642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f9a64-c43d-4d3e-8e3d-0e01541d05b6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.471103 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:28.509337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:28.527901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 797/1598] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:28.532034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096a39c-a85e-4de2-95fb-f19d17fbe996 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.540712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096a39c-a85e-4de2-95fb-f19d17fbe996 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.545988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01cb67-d9ea-4bbd-96bb-73afbeb0b5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.546702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01cb67-d9ea-4bbd-96bb-73afbeb0b5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.546984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01cb67-d9ea-4bbd-96bb-73afbeb0b5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.547259 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01cb67-d9ea-4bbd-96bb-73afbeb0b5f1 admin admin] PATH_INFO: `/v3/projects/d4fa2df3bcca46ad9f553d783f09b9ec/users/9cc946a45d8b47f2aac77320b4d75db2/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.554117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f9a64-c43d-4d3e-8e3d-0e01541d05b6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.560489 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd72f51-9ad8-41f7-98c8-7a7b894c1912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.561304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd72f51-9ad8-41f7-98c8-7a7b894c1912 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.561635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd72f51-9ad8-41f7-98c8-7a7b894c1912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.561916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd72f51-9ad8-41f7-98c8-7a7b894c1912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.562566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd72f51-9ad8-41f7-98c8-7a7b894c1912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.564176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd72f51-9ad8-41f7-98c8-7a7b894c1912 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.565039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01cb67-d9ea-4bbd-96bb-73afbeb0b5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4fa2df3bcca46ad9f553d783f09b9ec, user_id=9cc946a45d8b47f2aac77320b4d75db2, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.568308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01cb67-d9ea-4bbd-96bb-73afbeb0b5f1 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.575161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 802/1599] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.576071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd72f51-9ad8-41f7-98c8-7a7b894c1912 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.586323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd72f51-9ad8-41f7-98c8-7a7b894c1912 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.588090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 798/1600] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:28 2022] PUT /identity/v3/projects/d4fa2df3bcca46ad9f553d783f09b9ec/users/9cc946a45d8b47f2aac77320b4d75db2/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:28.594821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01cb67-d9ea-4bbd-96bb-73afbeb0b5f1 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.655116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f577061-492f-4302-94ca-465e451c7a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.656465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f577061-492f-4302-94ca-465e451c7a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.656888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f577061-492f-4302-94ca-465e451c7a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.657305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f577061-492f-4302-94ca-465e451c7a3e admin admin] PATH_INFO: `/v3/projects/58874b18c9be4155a7cdff000a132bc4/users/7a22b52fdd5b46229d7306086ae11738/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.670782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01cb67-d9ea-4bbd-96bb-73afbeb0b5f1 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.674412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f577061-492f-4302-94ca-465e451c7a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58874b18c9be4155a7cdff000a132bc4, user_id=7a22b52fdd5b46229d7306086ae11738, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.676446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e78bd-7bec-4814-be36-b7cf2320d8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.677234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e78bd-7bec-4814-be36-b7cf2320d8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.677426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f577061-492f-4302-94ca-465e451c7a3e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.677687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e78bd-7bec-4814-be36-b7cf2320d8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.678108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e78bd-7bec-4814-be36-b7cf2320d8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.678751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e78bd-7bec-4814-be36-b7cf2320d8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.680436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e78bd-7bec-4814-be36-b7cf2320d8ca admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.696251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 803/1601] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:28 2022] PUT /identity/v3/projects/58874b18c9be4155a7cdff000a132bc4/users/7a22b52fdd5b46229d7306086ae11738/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:28.697070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f577061-492f-4302-94ca-465e451c7a3e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.704652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 799/1602] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.706355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a961-9eb0-4b5d-aa7c-78da8c0acaa2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.706653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a961-9eb0-4b5d-aa7c-78da8c0acaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.706929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a961-9eb0-4b5d-aa7c-78da8c0acaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.741256 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-0c66a961-9eb0-4b5d-aa7c-78da8c0acaa2 None None] MFA Rules not processed for user `79fa6a6d279c4ed88f26062adfe2d3c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:28.742627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0c66a961-9eb0-4b5d-aa7c-78da8c0acaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:28.761728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f577061-492f-4302-94ca-465e451c7a3e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.767205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ea05-6f57-4d55-a031-c0a5c36a174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.767765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ea05-6f57-4d55-a031-c0a5c36a174e admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.768050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ea05-6f57-4d55-a031-c0a5c36a174e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.768323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ea05-6f57-4d55-a031-c0a5c36a174e admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.769065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86ea05-6f57-4d55-a031-c0a5c36a174e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.770668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86ea05-6f57-4d55-a031-c0a5c36a174e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.782601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 804/1603] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:28.783445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ea05-6f57-4d55-a031-c0a5c36a174e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.826294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 800/1604] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:28.827852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66a961-9eb0-4b5d-aa7c-78da8c0acaa2 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:28.840348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66a961-9eb0-4b5d-aa7c-78da8c0acaa2 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.846432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf8af3-127b-4c53-8020-d79f054c22ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.847391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf8af3-127b-4c53-8020-d79f054c22ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.847679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf8af3-127b-4c53-8020-d79f054c22ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.848069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf8af3-127b-4c53-8020-d79f054c22ef admin admin] PATH_INFO: `/v3/projects/13d3a2179f604751bb442e709fd6f6df/users/2ab7766b5f7b4fb694afa43a1bdb5b2f/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.863826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:28.865791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf8af3-127b-4c53-8020-d79f054c22ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d3a2179f604751bb442e709fd6f6df, user_id=2ab7766b5f7b4fb694afa43a1bdb5b2f, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.868967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf8af3-127b-4c53-8020-d79f054c22ef admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.873321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:28.877498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ea05-6f57-4d55-a031-c0a5c36a174e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:28.882277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043a508-3567-4fbe-9eca-aace8b419f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:28.882940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043a508-3567-4fbe-9eca-aace8b419f22 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.883256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043a508-3567-4fbe-9eca-aace8b419f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.883524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043a508-3567-4fbe-9eca-aace8b419f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.890431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 801/1605] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:28 2022] PUT /identity/v3/projects/13d3a2179f604751bb442e709fd6f6df/users/2ab7766b5f7b4fb694afa43a1bdb5b2f/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:28.892771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63c15b-012a-4428-8672-117668fafb82 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.893165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63c15b-012a-4428-8672-117668fafb82 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.894171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63c15b-012a-4428-8672-117668fafb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.894376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043a508-3567-4fbe-9eca-aace8b419f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:28.895929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043a508-3567-4fbe-9eca-aace8b419f22 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:28.907969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 805/1606] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:28.919271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7a5e5-62c4-4e44-9654-eb92b2c156c8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:28.919550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7a5e5-62c4-4e44-9654-eb92b2c156c8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:28.919817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7a5e5-62c4-4e44-9654-eb92b2c156c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:28.933843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-eb63c15b-012a-4428-8672-117668fafb82 None None] MFA Rules not processed for user `9cc946a45d8b47f2aac77320b4d75db2`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:28.936062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-eb63c15b-012a-4428-8672-117668fafb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:28.942044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fca7a5e5-62c4-4e44-9654-eb92b2c156c8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:28.943464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fca7a5e5-62c4-4e44-9654-eb92b2c156c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:29.017158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 802/1607] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:29.017158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63c15b-012a-4428-8672-117668fafb82 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:29.035004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 806/1608] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:29.035004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7a5e5-62c4-4e44-9654-eb92b2c156c8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:29.045780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7a5e5-62c4-4e44-9654-eb92b2c156c8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:29.051883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d13469-92f6-496e-b80e-b61fb86983f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:29.053085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d13469-92f6-496e-b80e-b61fb86983f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.053085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d13469-92f6-496e-b80e-b61fb86983f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.053792 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d13469-92f6-496e-b80e-b61fb86983f0 admin admin] PATH_INFO: `/v3/projects/da9fd3d45b4a4d55923d31a45beaca03/users/2e3b9349e30c47eabea55a3c42b80a0c/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.071476 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d13469-92f6-496e-b80e-b61fb86983f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9fd3d45b4a4d55923d31a45beaca03, user_id=2e3b9349e30c47eabea55a3c42b80a0c, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:29.074399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d13469-92f6-496e-b80e-b61fb86983f0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:29.092367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 807/1609] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:29 2022] PUT /identity/v3/projects/da9fd3d45b4a4d55923d31a45beaca03/users/2e3b9349e30c47eabea55a3c42b80a0c/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:29.093429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d13469-92f6-496e-b80e-b61fb86983f0 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:29.102484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63c15b-012a-4428-8672-117668fafb82 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:29.170850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d13469-92f6-496e-b80e-b61fb86983f0 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:29.175547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ba6b5-70ca-4863-a802-548e78f645ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:29.176775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ba6b5-70ca-4863-a802-548e78f645ac service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.177596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ba6b5-70ca-4863-a802-548e78f645ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.177596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ba6b5-70ca-4863-a802-548e78f645ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.231639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aef31-e647-460c-b07c-e492133543ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:29.232407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aef31-e647-460c-b07c-e492133543ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.232704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aef31-e647-460c-b07c-e492133543ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.233028 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aef31-e647-460c-b07c-e492133543ff admin admin] PATH_INFO: `/v3/projects/ce9a61dc2a034a95b620b5cebcec00af/users/8b4129783c6c409f955861384d315838/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.254188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aef31-e647-460c-b07c-e492133543ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9a61dc2a034a95b620b5cebcec00af, user_id=8b4129783c6c409f955861384d315838, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:29.257677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aef31-e647-460c-b07c-e492133543ff admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:29.261916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ba6b5-70ca-4863-a802-548e78f645ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:29.264743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ba6b5-70ca-4863-a802-548e78f645ac service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:29.275761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 803/1610] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:29 2022] PUT /identity/v3/projects/ce9a61dc2a034a95b620b5cebcec00af/users/8b4129783c6c409f955861384d315838/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:29.277428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f15d1-f93a-4f69-baac-dd0ad2e949b5 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.277766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f15d1-f93a-4f69-baac-dd0ad2e949b5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.279054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f15d1-f93a-4f69-baac-dd0ad2e949b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.292119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 808/1611] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:29.293189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ba6b5-70ca-4863-a802-548e78f645ac service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:29.315551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ba6b5-70ca-4863-a802-548e78f645ac service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:29.365423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:29.375450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-f98f15d1-f93a-4f69-baac-dd0ad2e949b5 None None] MFA Rules not processed for user `2ab7766b5f7b4fb694afa43a1bdb5b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:29.376704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f98f15d1-f93a-4f69-baac-dd0ad2e949b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:29.387283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:29.464563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0214b-b8bb-496e-b4a5-ad8d3c2d2129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:29.465209 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0214b-b8bb-496e-b4a5-ad8d3c2d2129 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.465517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0214b-b8bb-496e-b4a5-ad8d3c2d2129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.465793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0214b-b8bb-496e-b4a5-ad8d3c2d2129 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.466435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0214b-b8bb-496e-b4a5-ad8d3c2d2129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:29.468348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0214b-b8bb-496e-b4a5-ad8d3c2d2129 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:29.523818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 809/1612] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:29 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:29.524848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0214b-b8bb-496e-b4a5-ad8d3c2d2129 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:29.530549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 804/1613] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:29.532610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafd9de-0b25-4904-ad66-d475e976f4a1 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.533444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafd9de-0b25-4904-ad66-d475e976f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.533824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafd9de-0b25-4904-ad66-d475e976f4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.627919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-2aafd9de-0b25-4904-ad66-d475e976f4a1 None None] MFA Rules not processed for user `2e3b9349e30c47eabea55a3c42b80a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:29.629214 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2aafd9de-0b25-4904-ad66-d475e976f4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:29.697489 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0214b-b8bb-496e-b4a5-ad8d3c2d2129 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:29.708647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447dcac-0bb7-47bf-ad46-ff18c29cc969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:29.709463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447dcac-0bb7-47bf-ad46-ff18c29cc969 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.710315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447dcac-0bb7-47bf-ad46-ff18c29cc969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.710315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447dcac-0bb7-47bf-ad46-ff18c29cc969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.742611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 805/1614] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:29.745448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685cc83-5f32-4440-aebd-503fa351ef91 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.745795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685cc83-5f32-4440-aebd-503fa351ef91 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.748344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685cc83-5f32-4440-aebd-503fa351ef91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.782749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447dcac-0bb7-47bf-ad46-ff18c29cc969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:29.785438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447dcac-0bb7-47bf-ad46-ff18c29cc969 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:29.795938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 810/1615] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:29.796891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447dcac-0bb7-47bf-ad46-ff18c29cc969 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:29.810716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447dcac-0bb7-47bf-ad46-ff18c29cc969 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:29.817023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012fe93-e2f8-4f2f-94c2-2aa624ff549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:29.818245 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fe93-e2f8-4f2f-94c2-2aa624ff549c admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.818593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fe93-e2f8-4f2f-94c2-2aa624ff549c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.818927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fe93-e2f8-4f2f-94c2-2aa624ff549c admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.819675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012fe93-e2f8-4f2f-94c2-2aa624ff549c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:29.821851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012fe93-e2f8-4f2f-94c2-2aa624ff549c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:29.823795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c685cc83-5f32-4440-aebd-503fa351ef91 None None] MFA Rules not processed for user `8b4129783c6c409f955861384d315838`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:29.826196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c685cc83-5f32-4440-aebd-503fa351ef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:29.850026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 811/1616] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:29 2022] POST /identity/v3/users => generated 300 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:29.851741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94585d9-c491-4f8a-8ec5-45a97150b91f None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.853107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94585d9-c491-4f8a-8ec5-45a97150b91f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.853799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94585d9-c491-4f8a-8ec5-45a97150b91f None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.860943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 812/1617] 10.222.0.25 () {54 vars in 962 bytes} [Tue Aug 9 12:21:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:29.862107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94585d9-c491-4f8a-8ec5-45a97150b91f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:29.882588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94585d9-c491-4f8a-8ec5-45a97150b91f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:29.887959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170f418-3437-4b25-b3db-bc83e4987f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:29.888706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170f418-3437-4b25-b3db-bc83e4987f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:29.888993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170f418-3437-4b25-b3db-bc83e4987f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:29.889269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170f418-3437-4b25-b3db-bc83e4987f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:29.889907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170f418-3437-4b25-b3db-bc83e4987f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:29.892300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170f418-3437-4b25-b3db-bc83e4987f49 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:29.937363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 813/1618] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:29 2022] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:29.941942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170f418-3437-4b25-b3db-bc83e4987f49 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:29.975026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:30.034717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 806/1619] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:30.035899 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be18dc9-15ae-4cb9-9481-4ab23fba94c5 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.038731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be18dc9-15ae-4cb9-9481-4ab23fba94c5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.038990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be18dc9-15ae-4cb9-9481-4ab23fba94c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.067629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170f418-3437-4b25-b3db-bc83e4987f49 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.081207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537731fb-f0bf-46dc-b8d8-afa9e7c15f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.082334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537731fb-f0bf-46dc-b8d8-afa9e7c15f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.084329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537731fb-f0bf-46dc-b8d8-afa9e7c15f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.084329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537731fb-f0bf-46dc-b8d8-afa9e7c15f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.085095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537731fb-f0bf-46dc-b8d8-afa9e7c15f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.089371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537731fb-f0bf-46dc-b8d8-afa9e7c15f25 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.122738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 814/1620] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:30.125039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537731fb-f0bf-46dc-b8d8-afa9e7c15f25 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.148405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4be18dc9-15ae-4cb9-9481-4ab23fba94c5 None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:30.149232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537731fb-f0bf-46dc-b8d8-afa9e7c15f25 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.150072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4be18dc9-15ae-4cb9-9481-4ab23fba94c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:30.160251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:30.162535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c9310-63eb-40be-9d16-9498aa348601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.163674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c9310-63eb-40be-9d16-9498aa348601 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.167030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c9310-63eb-40be-9d16-9498aa348601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.167817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c9310-63eb-40be-9d16-9498aa348601 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.169728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c9310-63eb-40be-9d16-9498aa348601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.172763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c9310-63eb-40be-9d16-9498aa348601 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.220607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 815/1621] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:30 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:30.222559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c9310-63eb-40be-9d16-9498aa348601 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.254877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c9310-63eb-40be-9d16-9498aa348601 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.267747 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f09a87-7357-4e28-b2ae-74fa1bf30e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.268418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 807/1622] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Aug 9 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:30.268541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f09a87-7357-4e28-b2ae-74fa1bf30e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.268742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f09a87-7357-4e28-b2ae-74fa1bf30e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.268999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f09a87-7357-4e28-b2ae-74fa1bf30e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.269597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be18dc9-15ae-4cb9-9481-4ab23fba94c5 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.271847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f09a87-7357-4e28-b2ae-74fa1bf30e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.275335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f09a87-7357-4e28-b2ae-74fa1bf30e83 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.289842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be18dc9-15ae-4cb9-9481-4ab23fba94c5 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.301499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116a926-9b6c-44d1-afe2-7c5c9665ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.303053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116a926-9b6c-44d1-afe2-7c5c9665ad4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.303859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116a926-9b6c-44d1-afe2-7c5c9665ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.304864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116a926-9b6c-44d1-afe2-7c5c9665ad4d admin admin] PATH_INFO: `/v3/projects/7385aaf6b4cb4f8bae798e089eac8731/users/8ff6991a6b214451ba91bd8e66908759/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.328918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116a926-9b6c-44d1-afe2-7c5c9665ad4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7385aaf6b4cb4f8bae798e089eac8731, user_id=8ff6991a6b214451ba91bd8e66908759, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.335521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116a926-9b6c-44d1-afe2-7c5c9665ad4d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.336408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 816/1623] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:30 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:30.337653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f09a87-7357-4e28-b2ae-74fa1bf30e83 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.355779 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 808/1624] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:30 2022] PUT /identity/v3/projects/7385aaf6b4cb4f8bae798e089eac8731/users/8ff6991a6b214451ba91bd8e66908759/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:30.357798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116a926-9b6c-44d1-afe2-7c5c9665ad4d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.488480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f09a87-7357-4e28-b2ae-74fa1bf30e83 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.497301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116a926-9b6c-44d1-afe2-7c5c9665ad4d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.506293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac94911-c959-4902-a9f6-186fccfc0285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.506973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac94911-c959-4902-a9f6-186fccfc0285 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.507281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac94911-c959-4902-a9f6-186fccfc0285 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.507637 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac94911-c959-4902-a9f6-186fccfc0285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.612122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1f287-26fa-4f70-94d0-07e75758ab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.612979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1f287-26fa-4f70-94d0-07e75758ab98 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.613514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1f287-26fa-4f70-94d0-07e75758ab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.613886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1f287-26fa-4f70-94d0-07e75758ab98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.614642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1f287-26fa-4f70-94d0-07e75758ab98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.619680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1f287-26fa-4f70-94d0-07e75758ab98 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.642296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 817/1625] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:30.644458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1f287-26fa-4f70-94d0-07e75758ab98 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.667504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1f287-26fa-4f70-94d0-07e75758ab98 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.669561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac94911-c959-4902-a9f6-186fccfc0285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.673767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac94911-c959-4902-a9f6-186fccfc0285 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.676240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279161e6-e4d4-429b-8ac0-5a6ac34d9a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.677029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279161e6-e4d4-429b-8ac0-5a6ac34d9a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.677402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279161e6-e4d4-429b-8ac0-5a6ac34d9a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.678165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279161e6-e4d4-429b-8ac0-5a6ac34d9a08 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.678456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279161e6-e4d4-429b-8ac0-5a6ac34d9a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.680866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279161e6-e4d4-429b-8ac0-5a6ac34d9a08 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.698289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:30.704912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 809/1626] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:30.708471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac94911-c959-4902-a9f6-186fccfc0285 service nova] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.720061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 818/1627] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:30 2022] POST /identity/v3/users => generated 292 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:30.721171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279161e6-e4d4-429b-8ac0-5a6ac34d9a08 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.736416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac94911-c959-4902-a9f6-186fccfc0285 service nova] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.740746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279161e6-e4d4-429b-8ac0-5a6ac34d9a08 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.745156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655d05f-a8ef-4922-ba0f-ac78a3f564c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.746202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655d05f-a8ef-4922-ba0f-ac78a3f564c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.747094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655d05f-a8ef-4922-ba0f-ac78a3f564c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.747942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655d05f-a8ef-4922-ba0f-ac78a3f564c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.749636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655d05f-a8ef-4922-ba0f-ac78a3f564c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.752073 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb5f4-b202-43b6-aeef-48ad2c20dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.752849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655d05f-a8ef-4922-ba0f-ac78a3f564c4 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.753581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb5f4-b202-43b6-aeef-48ad2c20dd18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.755029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb5f4-b202-43b6-aeef-48ad2c20dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.755364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb5f4-b202-43b6-aeef-48ad2c20dd18 admin admin] PATH_INFO: `/v3/projects/d66ca528febe4cbf8b78105a4e50555b/users/ed4e58ae8d374e41901ea4119e6c5f29/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.779986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 810/1628] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:30.780850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655d05f-a8ef-4922-ba0f-ac78a3f564c4 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.786864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afb5f4-b202-43b6-aeef-48ad2c20dd18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66ca528febe4cbf8b78105a4e50555b, user_id=ed4e58ae8d374e41901ea4119e6c5f29, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.791407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afb5f4-b202-43b6-aeef-48ad2c20dd18 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.795377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:30.804108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655d05f-a8ef-4922-ba0f-ac78a3f564c4 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.817961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9023f9-0a48-431e-b4b3-00aac293f31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.819520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9023f9-0a48-431e-b4b3-00aac293f31a admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.820831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9023f9-0a48-431e-b4b3-00aac293f31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.824384 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 819/1629] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:30 2022] PUT /identity/v3/projects/d66ca528febe4cbf8b78105a4e50555b/users/ed4e58ae8d374e41901ea4119e6c5f29/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:30.824586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9023f9-0a48-431e-b4b3-00aac293f31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.824699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb5f4-b202-43b6-aeef-48ad2c20dd18 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.825456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9023f9-0a48-431e-b4b3-00aac293f31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.827977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9023f9-0a48-431e-b4b3-00aac293f31a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.848952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 811/1630] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:30.853498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9023f9-0a48-431e-b4b3-00aac293f31a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:30.877919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9023f9-0a48-431e-b4b3-00aac293f31a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.964052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb5f4-b202-43b6-aeef-48ad2c20dd18 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:30.975003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1a4a0-0d1c-4b6e-96d3-19699ca24a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.975683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1a4a0-0d1c-4b6e-96d3-19699ca24a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.975956 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1a4a0-0d1c-4b6e-96d3-19699ca24a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:30.976221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1a4a0-0d1c-4b6e-96d3-19699ca24a3a admin admin] PATH_INFO: `/v3/projects/7385aaf6b4cb4f8bae798e089eac8731/users/8ff6991a6b214451ba91bd8e66908759/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:30.978973 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1a4a0-0d1c-4b6e-96d3-19699ca24a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7385aaf6b4cb4f8bae798e089eac8731, user_id=8ff6991a6b214451ba91bd8e66908759, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:30.982443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1a4a0-0d1c-4b6e-96d3-19699ca24a3a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:30.998287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8381cc-803c-4953-a3c1-97ac98c58036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:30.999052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8381cc-803c-4953-a3c1-97ac98c58036 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:30.999327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8381cc-803c-4953-a3c1-97ac98c58036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:31.000560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8381cc-803c-4953-a3c1-97ac98c58036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:31.001975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8381cc-803c-4953-a3c1-97ac98c58036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:31.004369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8381cc-803c-4953-a3c1-97ac98c58036 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:31.009067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 820/1631] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:30 2022] PUT /identity/v3/projects/7385aaf6b4cb4f8bae798e089eac8731/users/8ff6991a6b214451ba91bd8e66908759/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:31.010696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1a4a0-0d1c-4b6e-96d3-19699ca24a3a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:31.030489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 812/1632] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:31.033502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ac2d4-9e2d-4f47-a665-b318d288743d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:31.033918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ac2d4-9e2d-4f47-a665-b318d288743d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:31.034186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ac2d4-9e2d-4f47-a665-b318d288743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:31.097377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-2b2ac2d4-9e2d-4f47-a665-b318d288743d None None] MFA Rules not processed for user `8ff6991a6b214451ba91bd8e66908759`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:31.098648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2b2ac2d4-9e2d-4f47-a665-b318d288743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:31.155175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1a4a0-0d1c-4b6e-96d3-19699ca24a3a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:31.166916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3d47-0774-454e-ba66-7786a9e60bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:31.168776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3d47-0774-454e-ba66-7786a9e60bff admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:31.169064 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3d47-0774-454e-ba66-7786a9e60bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:31.169319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3d47-0774-454e-ba66-7786a9e60bff admin admin] PATH_INFO: `/v3/projects/251ed40681da420eb17ed4d223b83d7d/users/fb012f40a9b348b8a42e351d26df942a/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:31.198343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f3d47-0774-454e-ba66-7786a9e60bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=251ed40681da420eb17ed4d223b83d7d, user_id=fb012f40a9b348b8a42e351d26df942a, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:31.204871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f3d47-0774-454e-ba66-7786a9e60bff admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:31.233792 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 821/1633] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:31 2022] PUT /identity/v3/projects/251ed40681da420eb17ed4d223b83d7d/users/fb012f40a9b348b8a42e351d26df942a/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:31.236378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3d47-0774-454e-ba66-7786a9e60bff admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:31.253679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 813/1634] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:31.255015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ac2d4-9e2d-4f47-a665-b318d288743d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:31.288786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ac2d4-9e2d-4f47-a665-b318d288743d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:31.346592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:31.372350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3d47-0774-454e-ba66-7786a9e60bff admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:31.385093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236ce2-9317-4cb4-9e7d-2b21e725b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:31.386581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236ce2-9317-4cb4-9e7d-2b21e725b7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:31.386746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236ce2-9317-4cb4-9e7d-2b21e725b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:31.387979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236ce2-9317-4cb4-9e7d-2b21e725b7f0 admin admin] PATH_INFO: `/v3/projects/d66ca528febe4cbf8b78105a4e50555b/users/ed4e58ae8d374e41901ea4119e6c5f29/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:31.393524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236ce2-9317-4cb4-9e7d-2b21e725b7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66ca528febe4cbf8b78105a4e50555b, user_id=ed4e58ae8d374e41901ea4119e6c5f29, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:31.394758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236ce2-9317-4cb4-9e7d-2b21e725b7f0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:31.411567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81913735-a19a-4bb2-a58a-32c6b89d4b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:31.412178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81913735-a19a-4bb2-a58a-32c6b89d4b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:31.412450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81913735-a19a-4bb2-a58a-32c6b89d4b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:31.412743 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81913735-a19a-4bb2-a58a-32c6b89d4b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:31.413871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81913735-a19a-4bb2-a58a-32c6b89d4b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:31.415616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81913735-a19a-4bb2-a58a-32c6b89d4b9f admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:31.435748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 822/1635] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:31 2022] PUT /identity/v3/projects/d66ca528febe4cbf8b78105a4e50555b/users/ed4e58ae8d374e41901ea4119e6c5f29/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:31.436408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236ce2-9317-4cb4-9e7d-2b21e725b7f0 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:31.437057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 814/1636] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:31.438585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c389fd8-5d7d-446f-88c0-b18ad6db9d0f None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:31.438922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c389fd8-5d7d-446f-88c0-b18ad6db9d0f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:31.439203 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c389fd8-5d7d-446f-88c0-b18ad6db9d0f None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:31.442936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 815/1637] 10.222.0.25 () {54 vars in 912 bytes} [Tue Aug 9 12:21:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:31.445569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d678-5b0e-458d-be82-78be7f2ba194 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:31.445854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d678-5b0e-458d-be82-78be7f2ba194 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:31.446125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6d678-5b0e-458d-be82-78be7f2ba194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:31.480236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:31.502364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-30a6d678-5b0e-458d-be82-78be7f2ba194 None None] MFA Rules not processed for user `ed4e58ae8d374e41901ea4119e6c5f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:31.505486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-30a6d678-5b0e-458d-be82-78be7f2ba194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:31.573181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236ce2-9317-4cb4-9e7d-2b21e725b7f0 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:31.587730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314e1dd-3192-42c9-8041-5b0f001219ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:31.588436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e1dd-3192-42c9-8041-5b0f001219ae service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:31.588751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e1dd-3192-42c9-8041-5b0f001219ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:31.589024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e1dd-3192-42c9-8041-5b0f001219ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:31.712492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 816/1638] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:31.713791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6d678-5b0e-458d-be82-78be7f2ba194 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:31.745682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314e1dd-3192-42c9-8041-5b0f001219ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:31.747730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314e1dd-3192-42c9-8041-5b0f001219ae service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:31.808060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 823/1639] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:31.811897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b270a-6553-4f5d-be1e-e12784aec80e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:31.812723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b270a-6553-4f5d-be1e-e12784aec80e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:31.813153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b270a-6553-4f5d-be1e-e12784aec80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:31.889454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-504b270a-6553-4f5d-be1e-e12784aec80e None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:31.893164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-504b270a-6553-4f5d-be1e-e12784aec80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:31.936206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6d678-5b0e-458d-be82-78be7f2ba194 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:31.945263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec299b0-f0d5-4110-a5c1-75a41b5c2f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:31.946176 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec299b0-f0d5-4110-a5c1-75a41b5c2f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:31.947284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec299b0-f0d5-4110-a5c1-75a41b5c2f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:31.947716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec299b0-f0d5-4110-a5c1-75a41b5c2f5f admin admin] PATH_INFO: `/v3/projects/251ed40681da420eb17ed4d223b83d7d/users/fb012f40a9b348b8a42e351d26df942a/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:31.951646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec299b0-f0d5-4110-a5c1-75a41b5c2f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=251ed40681da420eb17ed4d223b83d7d, user_id=fb012f40a9b348b8a42e351d26df942a, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:31.955638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec299b0-f0d5-4110-a5c1-75a41b5c2f5f admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:31.974325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 817/1640] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:31 2022] PUT /identity/v3/projects/251ed40681da420eb17ed4d223b83d7d/users/fb012f40a9b348b8a42e351d26df942a/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:31.975697 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec299b0-f0d5-4110-a5c1-75a41b5c2f5f admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:32.084688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 824/1641] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:32.086555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b270a-6553-4f5d-be1e-e12784aec80e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:32.128054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec299b0-f0d5-4110-a5c1-75a41b5c2f5f admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:32.140355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ece455-8316-4c17-a20d-bbca011e97a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:32.140749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b270a-6553-4f5d-be1e-e12784aec80e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:32.142600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ece455-8316-4c17-a20d-bbca011e97a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:32.143316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ece455-8316-4c17-a20d-bbca011e97a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:32.143597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ece455-8316-4c17-a20d-bbca011e97a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:32.212787 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:32.311483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:32.331502 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:32.332718 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:32.333137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:32.333535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] PATH_INFO: `/v3/users/9cc946a45d8b47f2aac77320b4d75db2` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:32.335031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc946a45d8b47f2aac77320b4d75db2)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:32.337821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:32.356985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ece455-8316-4c17-a20d-bbca011e97a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:32.358839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ece455-8316-4c17-a20d-bbca011e97a3 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:32.379479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 818/1642] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:32.381233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6b8ea-670b-47bc-b83b-5e52c7b9b308 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:32.384616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6b8ea-670b-47bc-b83b-5e52c7b9b308 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:32.385007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6b8ea-670b-47bc-b83b-5e52c7b9b308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:32.446181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc946a45d8b47f2aac77320b4d75db2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:32.458924 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9ef6b8ea-670b-47bc-b83b-5e52c7b9b308 None None] MFA Rules not processed for user `fb012f40a9b348b8a42e351d26df942a`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:32.462801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9ef6b8ea-670b-47bc-b83b-5e52c7b9b308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:32.474494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc946a45d8b47f2aac77320b4d75db2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:32.475259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc946a45d8b47f2aac77320b4d75db2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:32.475913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc946a45d8b47f2aac77320b4d75db2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:32.499101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc946a45d8b47f2aac77320b4d75db2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:32.551156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 825/1643] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:32 2022] DELETE /identity/v3/users/9cc946a45d8b47f2aac77320b4d75db2 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:32.553523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:32.565434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:32.678247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 819/1644] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:32.679816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103fa59-40f7-46dd-9f6e-f09fa7b70bb5 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:32.680104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103fa59-40f7-46dd-9f6e-f09fa7b70bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:32.680372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103fa59-40f7-46dd-9f6e-f09fa7b70bb5 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:32.690481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 820/1645] 10.222.0.25 () {54 vars in 962 bytes} [Tue Aug 9 12:21:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:32.691836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed865d7-43b5-4c3e-a8a6-21d4f29f9754 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:32.692117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed865d7-43b5-4c3e-a8a6-21d4f29f9754 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:32.692394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed865d7-43b5-4c3e-a8a6-21d4f29f9754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:32.744061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5ed865d7-43b5-4c3e-a8a6-21d4f29f9754 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:32.745976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5ed865d7-43b5-4c3e-a8a6-21d4f29f9754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:32.768191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100d3a2-e488-400b-88cc-c9c18405b603 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:32.773806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ea61f-430f-490e-bb65-9b19ac908d65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:32.774601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ea61f-430f-490e-bb65-9b19ac908d65 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:32.774982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ea61f-430f-490e-bb65-9b19ac908d65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:32.775359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ea61f-430f-490e-bb65-9b19ac908d65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:32.777573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-371ea61f-430f-490e-bb65-9b19ac908d65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:32.863188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:32.893585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ea61f-430f-490e-bb65-9b19ac908d65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:32.895913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ea61f-430f-490e-bb65-9b19ac908d65 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:32.928414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 821/1646] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:32.928748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 826/1647] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:32.929846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866b67-3134-4471-9ec4-6ad758429d14 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:32.930080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866b67-3134-4471-9ec4-6ad758429d14 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:32.930345 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866b67-3134-4471-9ec4-6ad758429d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:32.933551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ea61f-430f-490e-bb65-9b19ac908d65 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:32.937927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-371ea61f-430f-490e-bb65-9b19ac908d65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:32.952896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ea61f-430f-490e-bb65-9b19ac908d65 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:32.957920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7c183-8ede-4dc1-ace4-b9c6f7f88aac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:32.958548 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c183-8ede-4dc1-ace4-b9c6f7f88aac service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:32.958829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c183-8ede-4dc1-ace4-b9c6f7f88aac service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:32.959100 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c183-8ede-4dc1-ace4-b9c6f7f88aac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:32.988734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a5866b67-3134-4471-9ec4-6ad758429d14 None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:32.990036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a5866b67-3134-4471-9ec4-6ad758429d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:33.011545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 822/1648] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Aug 9 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:33.018494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c970a-1e8f-448d-9394-9f61acbc437f None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:33.018782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c970a-1e8f-448d-9394-9f61acbc437f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:33.019052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c970a-1e8f-448d-9394-9f61acbc437f None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:33.020603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 823/1649] 10.222.0.25 () {54 vars in 912 bytes} [Tue Aug 9 12:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:33.027396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137978c-e5cc-4848-941c-8f205f6963f7 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:33.027699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137978c-e5cc-4848-941c-8f205f6963f7 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:33.028498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137978c-e5cc-4848-941c-8f205f6963f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:33.074156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-8137978c-e5cc-4848-941c-8f205f6963f7 None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:33.077493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8137978c-e5cc-4848-941c-8f205f6963f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:33.113396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 824/1650] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:21:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:33.114400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137978c-e5cc-4848-941c-8f205f6963f7 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:33.118058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8137978c-e5cc-4848-941c-8f205f6963f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:33.124050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7c183-8ede-4dc1-ace4-b9c6f7f88aac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:33.125547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7c183-8ede-4dc1-ace4-b9c6f7f88aac service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:33.157316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 827/1651] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:33.243565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137978c-e5cc-4848-941c-8f205f6963f7 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:33.250767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca85fa-e63d-4a3a-9b60-77df3b68b415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:33.251000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca85fa-e63d-4a3a-9b60-77df3b68b415 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:33.251111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca85fa-e63d-4a3a-9b60-77df3b68b415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:33.251403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca85fa-e63d-4a3a-9b60-77df3b68b415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:33.260888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:33.267263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca85fa-e63d-4a3a-9b60-77df3b68b415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:33.268952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca85fa-e63d-4a3a-9b60-77df3b68b415 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:33.280201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 825/1652] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:33.353352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7c183-8ede-4dc1-ace4-b9c6f7f88aac service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:33.374725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7c183-8ede-4dc1-ace4-b9c6f7f88aac service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:33.378895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb7273-f1d6-4687-ac92-f12e7c4e6b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:33.379506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb7273-f1d6-4687-ac92-f12e7c4e6b03 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:33.379787 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb7273-f1d6-4687-ac92-f12e7c4e6b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:33.380057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb7273-f1d6-4687-ac92-f12e7c4e6b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:33.401111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb7273-f1d6-4687-ac92-f12e7c4e6b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:33.402738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb7273-f1d6-4687-ac92-f12e7c4e6b03 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:33.439462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 828/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:33.707085 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca85fa-e63d-4a3a-9b60-77df3b68b415 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:33.737521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca85fa-e63d-4a3a-9b60-77df3b68b415 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:33.751145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70973b-e0ec-40cb-8df5-a0d040bf63a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:33.753001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70973b-e0ec-40cb-8df5-a0d040bf63a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:33.755390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70973b-e0ec-40cb-8df5-a0d040bf63a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:33.755724 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70973b-e0ec-40cb-8df5-a0d040bf63a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:33.762195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1a70973b-e0ec-40cb-8df5-a0d040bf63a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:33.916712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70973b-e0ec-40cb-8df5-a0d040bf63a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:33.918266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70973b-e0ec-40cb-8df5-a0d040bf63a3 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:33.932094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 826/1654] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:34.726629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb7273-f1d6-4687-ac92-f12e7c4e6b03 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:34.730251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-80bb7273-f1d6-4687-ac92-f12e7c4e6b03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:34.773151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb7273-f1d6-4687-ac92-f12e7c4e6b03 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:34.788230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:34.791427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:34.792108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:34.792398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] PATH_INFO: `/v3/projects/d4fa2df3bcca46ad9f553d783f09b9ec` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:34.799823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4fa2df3bcca46ad9f553d783f09b9ec)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:34.802184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: WARNING py.warnings [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:21:34.802184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: warnings.warn(msg) Aug 09 12:21:34.802184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: Aug 09 12:21:34.814234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:34.961965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4fa2df3bcca46ad9f553d783f09b9ec', 'request_id': 'req-56fe0f84-3acd-4159-ac1c-78a5174041c9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:34.986388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4fa2df3bcca46ad9f553d783f09b9ec', 'request_id': 'req-56fe0f84-3acd-4159-ac1c-78a5174041c9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.000338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4fa2df3bcca46ad9f553d783f09b9ec', 'request_id': 'req-56fe0f84-3acd-4159-ac1c-78a5174041c9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.053199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] The token cache is being invalidate because project d4fa2df3bcca46ad9f553d783f09b9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:35.053488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.061843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.064411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 829/1655] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:34 2022] DELETE /identity/v3/projects/d4fa2df3bcca46ad9f553d783f09b9ec => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:35.068299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70973b-e0ec-40cb-8df5-a0d040bf63a3 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:35.089143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70973b-e0ec-40cb-8df5-a0d040bf63a3 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:35.247863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:35.248528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:35.248857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:35.249213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] PATH_INFO: `/v3/users/8ff6991a6b214451ba91bd8e66908759` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:35.251138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff6991a6b214451ba91bd8e66908759)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:35.254245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: WARNING py.warnings [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:21:35.254245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: warnings.warn(msg) Aug 09 12:21:35.254245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: Aug 09 12:21:35.256356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:35.264820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:35.266816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:35.291440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe0f84-3acd-4159-ac1c-78a5174041c9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:35.306727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:35.307442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:35.307719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:35.307992 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] PATH_INFO: `/v3/users/2e3b9349e30c47eabea55a3c42b80a0c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:35.314360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3b9349e30c47eabea55a3c42b80a0c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:35.319122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:35.403639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff6991a6b214451ba91bd8e66908759'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.407654 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:35.418186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3b9349e30c47eabea55a3c42b80a0c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.424211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff6991a6b214451ba91bd8e66908759'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.425011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff6991a6b214451ba91bd8e66908759'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.425883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff6991a6b214451ba91bd8e66908759'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.447346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3b9349e30c47eabea55a3c42b80a0c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.447763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-aaabe8c1-dade-4c16-80c1-8542569cb2bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff6991a6b214451ba91bd8e66908759'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.449676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3b9349e30c47eabea55a3c42b80a0c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.450793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3b9349e30c47eabea55a3c42b80a0c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.468905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3b9349e30c47eabea55a3c42b80a0c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:35.507299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 827/1656] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:35 2022] DELETE /identity/v3/users/8ff6991a6b214451ba91bd8e66908759 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:35.530757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 830/1657] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:35 2022] DELETE /identity/v3/users/2e3b9349e30c47eabea55a3c42b80a0c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:35.535819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bcff7-4de3-436f-a6e3-5b1e7a919ecc None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:35.536110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bcff7-4de3-436f-a6e3-5b1e7a919ecc None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:35.536545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bcff7-4de3-436f-a6e3-5b1e7a919ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:35.578223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-681bcff7-4de3-436f-a6e3-5b1e7a919ecc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:35.579992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-681bcff7-4de3-436f-a6e3-5b1e7a919ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:35.620088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:35.747238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 828/1658] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:35.833013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:35.835192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:36.005006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fe986-bb2a-46da-954b-3ad984b306d8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:36.015700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67044aa8-8812-41fb-a832-b7d6642d2249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:36.016371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044aa8-8812-41fb-a832-b7d6642d2249 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:36.016672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044aa8-8812-41fb-a832-b7d6642d2249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:36.017592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044aa8-8812-41fb-a832-b7d6642d2249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:36.045173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67044aa8-8812-41fb-a832-b7d6642d2249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:36.047951 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67044aa8-8812-41fb-a832-b7d6642d2249 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:36.074030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 831/1659] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:38.022795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bcff7-4de3-436f-a6e3-5b1e7a919ecc None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:38.029709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-681bcff7-4de3-436f-a6e3-5b1e7a919ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:38.080064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bcff7-4de3-436f-a6e3-5b1e7a919ecc None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:38.105309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:38.113894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:38.114865 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:38.115466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] PATH_INFO: `/v3/projects/da9fd3d45b4a4d55923d31a45beaca03` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:38.124928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9fd3d45b4a4d55923d31a45beaca03)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:38.135978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:38.161939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67044aa8-8812-41fb-a832-b7d6642d2249 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:38.164717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-67044aa8-8812-41fb-a832-b7d6642d2249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:38.185867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67044aa8-8812-41fb-a832-b7d6642d2249 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:38.208576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:38.209523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:38.209990 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:38.210574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] PATH_INFO: `/v3/projects/7385aaf6b4cb4f8bae798e089eac8731` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:38.212766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7385aaf6b4cb4f8bae798e089eac8731)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:38.214935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:38.354514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9fd3d45b4a4d55923d31a45beaca03', 'request_id': 'req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.380564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9fd3d45b4a4d55923d31a45beaca03', 'request_id': 'req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.392704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7385aaf6b4cb4f8bae798e089eac8731', 'request_id': 'req-5130c42b-dd72-495e-88bd-e5afa30c4378'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.411599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9fd3d45b4a4d55923d31a45beaca03', 'request_id': 'req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.432551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7385aaf6b4cb4f8bae798e089eac8731', 'request_id': 'req-5130c42b-dd72-495e-88bd-e5afa30c4378'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.447946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7385aaf6b4cb4f8bae798e089eac8731', 'request_id': 'req-5130c42b-dd72-495e-88bd-e5afa30c4378'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.450152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] The token cache is being invalidate because project da9fd3d45b4a4d55923d31a45beaca03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:38.450454 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.451388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.453682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 829/1660] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:38 2022] DELETE /identity/v3/projects/da9fd3d45b4a4d55923d31a45beaca03 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:38.455253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:38.457947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:38.488667 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] The token cache is being invalidate because project 7385aaf6b4cb4f8bae798e089eac8731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:38.490543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.491810 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.499062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 832/1661] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:38 2022] DELETE /identity/v3/projects/7385aaf6b4cb4f8bae798e089eac8731 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:21:38.500006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:38.504264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:38.662515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:38.692443 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a53a1-c1ef-4225-bd17-aa1fb13873cb admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:38.695478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130c42b-dd72-495e-88bd-e5afa30c4378 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:38.703967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:38.708090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:38.709546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:38.710056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] PATH_INFO: `/v3/users/2ab7766b5f7b4fb694afa43a1bdb5b2f` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:38.711551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab7766b5f7b4fb694afa43a1bdb5b2f)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:38.713756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:38.714424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:38.714707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:38.714983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] PATH_INFO: `/v3/users/ed4e58ae8d374e41901ea4119e6c5f29` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:38.715865 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:38.719321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4e58ae8d374e41901ea4119e6c5f29)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:38.721304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:38.837896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4e58ae8d374e41901ea4119e6c5f29'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.849442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4e58ae8d374e41901ea4119e6c5f29'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.850561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4e58ae8d374e41901ea4119e6c5f29'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.851341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4e58ae8d374e41901ea4119e6c5f29'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.862019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-64433a92-13a3-42b8-9601-db466976fd3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4e58ae8d374e41901ea4119e6c5f29'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.862578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:38.889289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 833/1662] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:38 2022] DELETE /identity/v3/users/ed4e58ae8d374e41901ea4119e6c5f29 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:38.891205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df708ee-e2b0-4b4b-b8a9-c0d2fee521d1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:38.891767 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df708ee-e2b0-4b4b-b8a9-c0d2fee521d1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:38.892218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df708ee-e2b0-4b4b-b8a9-c0d2fee521d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:38.895687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab7766b5f7b4fb694afa43a1bdb5b2f'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.910056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab7766b5f7b4fb694afa43a1bdb5b2f'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.911238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab7766b5f7b4fb694afa43a1bdb5b2f'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.913021 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab7766b5f7b4fb694afa43a1bdb5b2f'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.923013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0df708ee-e2b0-4b4b-b8a9-c0d2fee521d1 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:38.925157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0df708ee-e2b0-4b4b-b8a9-c0d2fee521d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:38.940341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-34b6ca51-a484-417c-943e-3658d8808fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab7766b5f7b4fb694afa43a1bdb5b2f'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:38.993646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 830/1663] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:38 2022] DELETE /identity/v3/users/2ab7766b5f7b4fb694afa43a1bdb5b2f => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:38.995061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e3efe-f91b-46b3-abd7-d8fc7aad562f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:38.995350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e3efe-f91b-46b3-abd7-d8fc7aad562f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:38.995912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e3efe-f91b-46b3-abd7-d8fc7aad562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:39.014822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 834/1664] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:39.022943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101fb8-eff8-48c5-9c06-8eabb43a73cc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:39.023800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101fb8-eff8-48c5-9c06-8eabb43a73cc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:39.024323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101fb8-eff8-48c5-9c06-8eabb43a73cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:39.041987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-cb3e3efe-f91b-46b3-abd7-d8fc7aad562f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:39.044572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-cb3e3efe-f91b-46b3-abd7-d8fc7aad562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:39.082066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a8101fb8-eff8-48c5-9c06-8eabb43a73cc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:39.085706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a8101fb8-eff8-48c5-9c06-8eabb43a73cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:39.222530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 831/1665] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:39.233706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 835/1666] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:21:39.234904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e3efe-f91b-46b3-abd7-d8fc7aad562f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:39.248327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8101fb8-eff8-48c5-9c06-8eabb43a73cc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:39.251295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e3efe-f91b-46b3-abd7-d8fc7aad562f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:39.251599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a8101fb8-eff8-48c5-9c06-8eabb43a73cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:39.258671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be0486-9884-47f1-a2ba-33bc3b474c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:39.259830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0486-9884-47f1-a2ba-33bc3b474c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:39.260446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0486-9884-47f1-a2ba-33bc3b474c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:39.260999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0486-9884-47f1-a2ba-33bc3b474c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:39.262144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be0486-9884-47f1-a2ba-33bc3b474c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:39.264284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be0486-9884-47f1-a2ba-33bc3b474c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:39.266545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be0486-9884-47f1-a2ba-33bc3b474c1a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:39.272840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:39.291760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 832/1667] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:39.306585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be0486-9884-47f1-a2ba-33bc3b474c1a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:39.344765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be0486-9884-47f1-a2ba-33bc3b474c1a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:39.351898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a92b-b806-4270-8dca-37c13177a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:39.353042 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a92b-b806-4270-8dca-37c13177a766 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:39.353525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a92b-b806-4270-8dca-37c13177a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:39.354176 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a92b-b806-4270-8dca-37c13177a766 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:39.354571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a92b-b806-4270-8dca-37c13177a766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:39.359686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a92b-b806-4270-8dca-37c13177a766 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:39.395762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8101fb8-eff8-48c5-9c06-8eabb43a73cc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:39.408904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6314c9-22c0-46ca-94b9-ffea745d8f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:39.409831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6314c9-22c0-46ca-94b9-ffea745d8f4e service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:39.410321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6314c9-22c0-46ca-94b9-ffea745d8f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:39.410898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6314c9-22c0-46ca-94b9-ffea745d8f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:39.433263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6314c9-22c0-46ca-94b9-ffea745d8f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:39.437177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6314c9-22c0-46ca-94b9-ffea745d8f4e service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:39.456920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 833/1668] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:39 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:39.460859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a92b-b806-4270-8dca-37c13177a766 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:39.476854 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 836/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:21:39.645293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a92b-b806-4270-8dca-37c13177a766 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:39.656162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4def1-e473-41a5-92e5-1fff868d3d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:39.657967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4def1-e473-41a5-92e5-1fff868d3d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:39.659816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4def1-e473-41a5-92e5-1fff868d3d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:39.660299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4def1-e473-41a5-92e5-1fff868d3d5c admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:39.662570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4def1-e473-41a5-92e5-1fff868d3d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:39.669080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4def1-e473-41a5-92e5-1fff868d3d5c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:39.724768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6314c9-22c0-46ca-94b9-ffea745d8f4e service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:39.724888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 834/1670] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:39 2022] POST /identity/v3/users => generated 295 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:39.746641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6314c9-22c0-46ca-94b9-ffea745d8f4e service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:39.767326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a748fcf-a7cd-4f7d-ac92-8b2c0763d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:39.767963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a748fcf-a7cd-4f7d-ac92-8b2c0763d3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:39.768239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a748fcf-a7cd-4f7d-ac92-8b2c0763d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:39.768516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a748fcf-a7cd-4f7d-ac92-8b2c0763d3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:39.769198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a748fcf-a7cd-4f7d-ac92-8b2c0763d3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:39.770915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a748fcf-a7cd-4f7d-ac92-8b2c0763d3bb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:39.802512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 837/1671] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:21:39.804511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4def1-e473-41a5-92e5-1fff868d3d5c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:39.821983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4def1-e473-41a5-92e5-1fff868d3d5c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:39.832381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c907317-9fca-4db6-bb90-9996718f1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:39.833923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907317-9fca-4db6-bb90-9996718f1d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:39.836295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907317-9fca-4db6-bb90-9996718f1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:39.839988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907317-9fca-4db6-bb90-9996718f1d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:39.844218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c907317-9fca-4db6-bb90-9996718f1d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:39.854003 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c907317-9fca-4db6-bb90-9996718f1d06 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:39.868670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:39.882611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 835/1672] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:39.883608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a748fcf-a7cd-4f7d-ac92-8b2c0763d3bb admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:39.901487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a748fcf-a7cd-4f7d-ac92-8b2c0763d3bb admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:39.922315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f0fdf-6927-4100-b0e0-34b3634ededd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:39.923006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f0fdf-6927-4100-b0e0-34b3634ededd admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:39.923424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f0fdf-6927-4100-b0e0-34b3634ededd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:39.923519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f0fdf-6927-4100-b0e0-34b3634ededd admin admin] PATH_INFO: `/v3/projects/9f6752ca2b8643f39976335a817afae5/users/c33c324571124b3a83217425f8f29100/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:40.002186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f0fdf-6927-4100-b0e0-34b3634ededd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6752ca2b8643f39976335a817afae5, user_id=c33c324571124b3a83217425f8f29100, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:40.004877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f0fdf-6927-4100-b0e0-34b3634ededd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:40.064313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 838/1673] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:39 2022] PUT /identity/v3/projects/9f6752ca2b8643f39976335a817afae5/users/c33c324571124b3a83217425f8f29100/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:21:40.079499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc0add-739e-4d34-8bce-9caf637b37fb None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:40.080141 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc0add-739e-4d34-8bce-9caf637b37fb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:40.080141 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc0add-739e-4d34-8bce-9caf637b37fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:40.133676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-83fc0add-739e-4d34-8bce-9caf637b37fb None None] MFA Rules not processed for user `c33c324571124b3a83217425f8f29100`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:40.135847 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-83fc0add-739e-4d34-8bce-9caf637b37fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:40.323225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 836/1674] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:40.329315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f0fdf-6927-4100-b0e0-34b3634ededd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:40.504776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f0fdf-6927-4100-b0e0-34b3634ededd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:40.512798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92c7a-2140-41dc-99f4-932a2e9c19c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:40.514618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92c7a-2140-41dc-99f4-932a2e9c19c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:40.514899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92c7a-2140-41dc-99f4-932a2e9c19c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:40.515174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92c7a-2140-41dc-99f4-932a2e9c19c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:40.519024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d92c7a-2140-41dc-99f4-932a2e9c19c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:40.524742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d92c7a-2140-41dc-99f4-932a2e9c19c4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:40.603078 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 839/1675] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:40 2022] POST /identity/v3/projects => generated 389 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:40.608582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc0add-739e-4d34-8bce-9caf637b37fb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:40.628088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc0add-739e-4d34-8bce-9caf637b37fb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:40.831318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26da73-4975-4f0c-aa34-c02c4ea53e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:40.832515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26da73-4975-4f0c-aa34-c02c4ea53e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:40.833180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26da73-4975-4f0c-aa34-c02c4ea53e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:40.833912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26da73-4975-4f0c-aa34-c02c4ea53e25 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:40.835611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26da73-4975-4f0c-aa34-c02c4ea53e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:40.838390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26da73-4975-4f0c-aa34-c02c4ea53e25 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:40.918887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92c7a-2140-41dc-99f4-932a2e9c19c4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:40.922741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a7d92c7a-2140-41dc-99f4-932a2e9c19c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:40.936663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 837/1676] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:40 2022] POST /identity/v3/users => generated 301 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:40.942271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26da73-4975-4f0c-aa34-c02c4ea53e25 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:40.972301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92c7a-2140-41dc-99f4-932a2e9c19c4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:40.978302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:40.978302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:40.978302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:40.978636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] PATH_INFO: `/v3/projects/d66ca528febe4cbf8b78105a4e50555b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:40.979958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66ca528febe4cbf8b78105a4e50555b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:40.981886 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26da73-4975-4f0c-aa34-c02c4ea53e25 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:40.985079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:41.005010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31938-4659-499f-97e7-27df3e0437bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:41.005767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31938-4659-499f-97e7-27df3e0437bf admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:41.006098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31938-4659-499f-97e7-27df3e0437bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:41.006321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31938-4659-499f-97e7-27df3e0437bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:41.010422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae31938-4659-499f-97e7-27df3e0437bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:41.016481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae31938-4659-499f-97e7-27df3e0437bf admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:41.063987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 838/1677] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:41.068979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31938-4659-499f-97e7-27df3e0437bf admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:41.117790 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31938-4659-499f-97e7-27df3e0437bf admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:41.143351 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66ca528febe4cbf8b78105a4e50555b', 'request_id': 'req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:41.154539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:41.159564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66ca528febe4cbf8b78105a4e50555b', 'request_id': 'req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:41.176211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66ca528febe4cbf8b78105a4e50555b', 'request_id': 'req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:41.203829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] The token cache is being invalidate because project d66ca528febe4cbf8b78105a4e50555b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:41.204236 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:41.205375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8ceaf67f-7eca-4fe4-a264-63eabfef1b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:41.211607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 840/1678] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:40 2022] DELETE /identity/v3/projects/d66ca528febe4cbf8b78105a4e50555b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:41.221285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffd486-6698-4ec9-8354-9dc0b7a82472 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:41.221761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffd486-6698-4ec9-8354-9dc0b7a82472 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:41.222142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffd486-6698-4ec9-8354-9dc0b7a82472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:41.266654 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-31ffd486-6698-4ec9-8354-9dc0b7a82472 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:41.269671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-31ffd486-6698-4ec9-8354-9dc0b7a82472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:41.312050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d4476-9b8a-4346-9f8e-3c033d512fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:41.312794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d4476-9b8a-4346-9f8e-3c033d512fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:41.313078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d4476-9b8a-4346-9f8e-3c033d512fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:41.313352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d4476-9b8a-4346-9f8e-3c033d512fbc admin admin] PATH_INFO: `/v3/projects/b6ac8acbd95c4e1fa5cd27ad2685d3df/users/05144d2afb3643aabbed2e03f0c5d6f6/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:41.348923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:41.362629 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d4476-9b8a-4346-9f8e-3c033d512fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ac8acbd95c4e1fa5cd27ad2685d3df, user_id=05144d2afb3643aabbed2e03f0c5d6f6, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:41.380213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d4476-9b8a-4346-9f8e-3c033d512fbc admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:41.407071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 839/1679] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:41 2022] PUT /identity/v3/projects/b6ac8acbd95c4e1fa5cd27ad2685d3df/users/05144d2afb3643aabbed2e03f0c5d6f6/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:41.408228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d4476-9b8a-4346-9f8e-3c033d512fbc admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:41.413068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-189d4476-9b8a-4346-9f8e-3c033d512fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:41.457071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 841/1680] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:41.457071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d343-1d81-4690-957e-07f4a954c6f6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:41.457071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d343-1d81-4690-957e-07f4a954c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:41.457071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d343-1d81-4690-957e-07f4a954c6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:41.531467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a515d343-1d81-4690-957e-07f4a954c6f6 None None] MFA Rules not processed for user `fcedc1966e19490fb739046a3379b135`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:41.533541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a515d343-1d81-4690-957e-07f4a954c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:41.575506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d4476-9b8a-4346-9f8e-3c033d512fbc admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:41.591009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b7273-5b0c-4d2f-aaf0-8e66a0a0fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:41.591790 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7273-5b0c-4d2f-aaf0-8e66a0a0fe3d admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:41.592180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7273-5b0c-4d2f-aaf0-8e66a0a0fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:41.592561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7273-5b0c-4d2f-aaf0-8e66a0a0fe3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:41.593346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b7273-5b0c-4d2f-aaf0-8e66a0a0fe3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:41.596160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b7273-5b0c-4d2f-aaf0-8e66a0a0fe3d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:41.623735 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 840/1681] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:41.629570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc70c3-344b-4294-a9b4-b835d845fb53 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:41.630490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc70c3-344b-4294-a9b4-b835d845fb53 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:41.630875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc70c3-344b-4294-a9b4-b835d845fb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:41.671852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-08bc70c3-344b-4294-a9b4-b835d845fb53 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:41.678004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-08bc70c3-344b-4294-a9b4-b835d845fb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:41.699556 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 842/1682] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:41.701208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d343-1d81-4690-957e-07f4a954c6f6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:41.704670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 841/1683] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:41.706071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc70c3-344b-4294-a9b4-b835d845fb53 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:41.744676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d343-1d81-4690-957e-07f4a954c6f6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:41.744847 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc70c3-344b-4294-a9b4-b835d845fb53 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:41.774516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30249a8-1884-472e-ac1f-8f0dfac92c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:41.775763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df69a-243a-4f0a-bb6a-0f1400d0ebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:41.776434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30249a8-1884-472e-ac1f-8f0dfac92c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:41.777638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df69a-243a-4f0a-bb6a-0f1400d0ebc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:41.777915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df69a-243a-4f0a-bb6a-0f1400d0ebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:41.778295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30249a8-1884-472e-ac1f-8f0dfac92c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:41.778586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30249a8-1884-472e-ac1f-8f0dfac92c3b admin admin] PATH_INFO: `/v3/projects/b6ac8acbd95c4e1fa5cd27ad2685d3df/users/05144d2afb3643aabbed2e03f0c5d6f6/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:41.780755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df69a-243a-4f0a-bb6a-0f1400d0ebc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:41.782501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df69a-243a-4f0a-bb6a-0f1400d0ebc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:41.783101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df69a-243a-4f0a-bb6a-0f1400d0ebc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:41.784018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30249a8-1884-472e-ac1f-8f0dfac92c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ac8acbd95c4e1fa5cd27ad2685d3df, user_id=05144d2afb3643aabbed2e03f0c5d6f6, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:41.790714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df69a-243a-4f0a-bb6a-0f1400d0ebc1 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:41.790846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30249a8-1884-472e-ac1f-8f0dfac92c3b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:41.823119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 843/1684] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:41 2022] PUT /identity/v3/projects/b6ac8acbd95c4e1fa5cd27ad2685d3df/users/05144d2afb3643aabbed2e03f0c5d6f6/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:41.832757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30249a8-1884-472e-ac1f-8f0dfac92c3b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:41.837968 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c30249a8-1884-472e-ac1f-8f0dfac92c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:41.841322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 842/1685] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:41.851035 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377024c-fac6-4f79-ba48-65d1dd4ff23b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:41.851467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377024c-fac6-4f79-ba48-65d1dd4ff23b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:41.851715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377024c-fac6-4f79-ba48-65d1dd4ff23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:41.901405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-b377024c-fac6-4f79-ba48-65d1dd4ff23b None None] MFA Rules not processed for user `646ce2a5be91485a9f785e7f41a3e9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:41.903552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b377024c-fac6-4f79-ba48-65d1dd4ff23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:41.960511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:41.998050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30249a8-1884-472e-ac1f-8f0dfac92c3b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:42.013887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cb494-b4ad-4ee9-9660-ffd0abb5f219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:42.014581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cb494-b4ad-4ee9-9660-ffd0abb5f219 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:42.014858 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cb494-b4ad-4ee9-9660-ffd0abb5f219 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:42.015169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cb494-b4ad-4ee9-9660-ffd0abb5f219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:42.047837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 843/1686] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:42.048937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce682a61-3de4-4083-9c88-31613f0a36a2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:42.049220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce682a61-3de4-4083-9c88-31613f0a36a2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:42.049601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce682a61-3de4-4083-9c88-31613f0a36a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:42.144791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ce682a61-3de4-4083-9c88-31613f0a36a2 None None] MFA Rules not processed for user `05144d2afb3643aabbed2e03f0c5d6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:42.146113 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ce682a61-3de4-4083-9c88-31613f0a36a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:42.194823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cb494-b4ad-4ee9-9660-ffd0abb5f219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:42.199712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cb494-b4ad-4ee9-9660-ffd0abb5f219 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:42.227275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 844/1687] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:42.228196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cb494-b4ad-4ee9-9660-ffd0abb5f219 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:42.263510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:42.335204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 844/1688] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:42.336334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce682a61-3de4-4083-9c88-31613f0a36a2 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:42.348130 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ce682a61-3de4-4083-9c88-31613f0a36a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:42.373802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cb494-b4ad-4ee9-9660-ffd0abb5f219 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:42.383434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3cda8-be99-4c3b-82b1-39aa0ec4d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:42.384306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3cda8-be99-4c3b-82b1-39aa0ec4d79e admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:42.385430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3cda8-be99-4c3b-82b1-39aa0ec4d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:42.388151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3cda8-be99-4c3b-82b1-39aa0ec4d79e admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:42.389051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3cda8-be99-4c3b-82b1-39aa0ec4d79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:42.391002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3cda8-be99-4c3b-82b1-39aa0ec4d79e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:42.463132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 845/1689] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:42 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:42.466135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae1daf-d54c-46dd-b762-48c46d3efc14 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:42.472046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae1daf-d54c-46dd-b762-48c46d3efc14 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:42.472751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae1daf-d54c-46dd-b762-48c46d3efc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:42.494054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce682a61-3de4-4083-9c88-31613f0a36a2 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:42.528257 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bbae1daf-d54c-46dd-b762-48c46d3efc14 None None] MFA Rules not processed for user `646ce2a5be91485a9f785e7f41a3e9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:42.532997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bbae1daf-d54c-46dd-b762-48c46d3efc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:42.663921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 846/1690] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:42.665008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae1daf-d54c-46dd-b762-48c46d3efc14 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:42.667575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bbae1daf-d54c-46dd-b762-48c46d3efc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:42.701325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:42.702157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:42.706741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:42.707121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] PATH_INFO: `/v3/projects/13d3a2179f604751bb442e709fd6f6df` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:42.709336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d3a2179f604751bb442e709fd6f6df)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:42.711730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:42.748475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:42.786127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d3a2179f604751bb442e709fd6f6df', 'request_id': 'req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:42.798427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d3a2179f604751bb442e709fd6f6df', 'request_id': 'req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:42.803965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae1daf-d54c-46dd-b762-48c46d3efc14 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:42.809445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d3a2179f604751bb442e709fd6f6df', 'request_id': 'req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:42.829789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] The token cache is being invalidate because project 13d3a2179f604751bb442e709fd6f6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:42.830875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:42.832248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:42.845475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 845/1691] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:42 2022] DELETE /identity/v3/projects/13d3a2179f604751bb442e709fd6f6df => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:42.846490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:42.850637 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:42.910481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:42.946443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018188a-8929-4bed-beb5-a3d7c7b63fa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:42.947266 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018188a-8929-4bed-beb5-a3d7c7b63fa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:42.947610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018188a-8929-4bed-beb5-a3d7c7b63fa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:42.947984 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018188a-8929-4bed-beb5-a3d7c7b63fa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:42.953228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9018188a-8929-4bed-beb5-a3d7c7b63fa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:43.018788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c22d8-005d-45a2-94d7-33a7c19a2f4e admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:43.035518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9fbf2-95c0-4f88-86dc-d2b7960a682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:43.040712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9fbf2-95c0-4f88-86dc-d2b7960a682a admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:43.042584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9fbf2-95c0-4f88-86dc-d2b7960a682a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:43.043146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9fbf2-95c0-4f88-86dc-d2b7960a682a admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:43.046605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9fbf2-95c0-4f88-86dc-d2b7960a682a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:43.061119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9fbf2-95c0-4f88-86dc-d2b7960a682a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:43.119756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 846/1692] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:42 2022] POST /identity/v3/users => generated 283 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:43.123188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9fbf2-95c0-4f88-86dc-d2b7960a682a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:43.127234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-76c9fbf2-95c0-4f88-86dc-d2b7960a682a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:43.140446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018188a-8929-4bed-beb5-a3d7c7b63fa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:43.143144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018188a-8929-4bed-beb5-a3d7c7b63fa7 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:43.161949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 847/1693] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:43.166198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba4b3-8869-415d-bc0f-5233ec68bfe6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:43.166825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba4b3-8869-415d-bc0f-5233ec68bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:43.168010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba4b3-8869-415d-bc0f-5233ec68bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:43.224143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b6cba4b3-8869-415d-bc0f-5233ec68bfe6 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:43.225386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b6cba4b3-8869-415d-bc0f-5233ec68bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:43.254337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 848/1694] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:43.256990 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cba4b3-8869-415d-bc0f-5233ec68bfe6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:43.287025 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cba4b3-8869-415d-bc0f-5233ec68bfe6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:43.304163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a80872-9a6c-4dee-8e13-de861ca12fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:43.304939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80872-9a6c-4dee-8e13-de861ca12fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:43.305469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80872-9a6c-4dee-8e13-de861ca12fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:43.305765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80872-9a6c-4dee-8e13-de861ca12fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:43.306600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a80872-9a6c-4dee-8e13-de861ca12fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:43.308278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a80872-9a6c-4dee-8e13-de861ca12fbc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:43.355005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 849/1695] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:43.357130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8239b-a8fa-418d-884f-fe34ca59a360 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:43.357414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8239b-a8fa-418d-884f-fe34ca59a360 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:43.357685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8239b-a8fa-418d-884f-fe34ca59a360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:43.433577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-eaa8239b-a8fa-418d-884f-fe34ca59a360 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:43.434632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9fbf2-95c0-4f88-86dc-d2b7960a682a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:43.437153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-eaa8239b-a8fa-418d-884f-fe34ca59a360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:43.456339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522aba9-46a1-461a-8250-67924e173a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:43.458746 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522aba9-46a1-461a-8250-67924e173a89 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:43.459221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522aba9-46a1-461a-8250-67924e173a89 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:43.462432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522aba9-46a1-461a-8250-67924e173a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:43.471902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5522aba9-46a1-461a-8250-67924e173a89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:43.475456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 850/1696] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:43.477139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8239b-a8fa-418d-884f-fe34ca59a360 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:43.532354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8239b-a8fa-418d-884f-fe34ca59a360 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:43.556034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723d6d0-f2d8-4d03-a039-f9127427b91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:43.556324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723d6d0-f2d8-4d03-a039-f9127427b91b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:43.556824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723d6d0-f2d8-4d03-a039-f9127427b91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:43.557205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723d6d0-f2d8-4d03-a039-f9127427b91b admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:43.558474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723d6d0-f2d8-4d03-a039-f9127427b91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:43.563245 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723d6d0-f2d8-4d03-a039-f9127427b91b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:43.588006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 851/1697] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:43.604960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723d6d0-f2d8-4d03-a039-f9127427b91b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:43.627838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723d6d0-f2d8-4d03-a039-f9127427b91b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:43.676779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae99c84-725f-40ef-a36a-6e9faf8f23cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:43.677772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae99c84-725f-40ef-a36a-6e9faf8f23cd admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:43.679394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae99c84-725f-40ef-a36a-6e9faf8f23cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:43.682665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae99c84-725f-40ef-a36a-6e9faf8f23cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:43.684425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae99c84-725f-40ef-a36a-6e9faf8f23cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:43.684425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae99c84-725f-40ef-a36a-6e9faf8f23cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:43.697304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae99c84-725f-40ef-a36a-6e9faf8f23cd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:43.719593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522aba9-46a1-461a-8250-67924e173a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:43.721296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522aba9-46a1-461a-8250-67924e173a89 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:43.738363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 852/1698] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:43.749147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae99c84-725f-40ef-a36a-6e9faf8f23cd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:43.751728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 847/1699] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:43.753527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bae99c84-725f-40ef-a36a-6e9faf8f23cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:43.755892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522aba9-46a1-461a-8250-67924e173a89 service nova] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:43.797286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522aba9-46a1-461a-8250-67924e173a89 service nova] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:43.799293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae99c84-725f-40ef-a36a-6e9faf8f23cd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:43.815442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa120522-00b6-4ad8-bf76-2e06c82bf18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:43.816461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:43.816996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa120522-00b6-4ad8-bf76-2e06c82bf18c admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:43.817276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa120522-00b6-4ad8-bf76-2e06c82bf18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:43.817544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa120522-00b6-4ad8-bf76-2e06c82bf18c admin admin] PATH_INFO: `/v3/projects/34f24346b173408a928ed30a49f38a96/users/8088799006474cbbb6ddf6544ce0b43b/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:43.819552 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:43.821206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:43.821932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] PATH_INFO: `/v3/users/c33c324571124b3a83217425f8f29100` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:43.825750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33c324571124b3a83217425f8f29100)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:43.829446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:43.873943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa120522-00b6-4ad8-bf76-2e06c82bf18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f24346b173408a928ed30a49f38a96, user_id=8088799006474cbbb6ddf6544ce0b43b, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:43.877056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa120522-00b6-4ad8-bf76-2e06c82bf18c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:43.911263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 848/1700] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:43 2022] PUT /identity/v3/projects/34f24346b173408a928ed30a49f38a96/users/8088799006474cbbb6ddf6544ce0b43b/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:43.915964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa120522-00b6-4ad8-bf76-2e06c82bf18c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:43.919917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-fa120522-00b6-4ad8-bf76-2e06c82bf18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:43.976929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:43.991051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:44.001061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33c324571124b3a83217425f8f29100'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:44.049646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33c324571124b3a83217425f8f29100'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:44.052189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33c324571124b3a83217425f8f29100'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:44.055189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33c324571124b3a83217425f8f29100'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:44.078289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33c324571124b3a83217425f8f29100'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:44.114633 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 853/1701] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:43 2022] DELETE /identity/v3/users/c33c324571124b3a83217425f8f29100 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:44.120896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:44.123332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:44.155585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa120522-00b6-4ad8-bf76-2e06c82bf18c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:44.267741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:44.269216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:44.270245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:44.270245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] PATH_INFO: `/v3/users/79fa6a6d279c4ed88f26062adfe2d3c6` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:44.271692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fa6a6d279c4ed88f26062adfe2d3c6)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:44.274774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:44.275338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4713-cf50-4a89-b89d-202c754cd07a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:44.287367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8023831-e43c-4574-a418-0a8598fce63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:44.290155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8023831-e43c-4574-a418-0a8598fce63f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:44.291598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8023831-e43c-4574-a418-0a8598fce63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:44.292144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8023831-e43c-4574-a418-0a8598fce63f admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:44.295252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8023831-e43c-4574-a418-0a8598fce63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:44.304076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8023831-e43c-4574-a418-0a8598fce63f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:44.374864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 854/1702] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:44 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:44.377319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff009a-cf26-4f3a-b443-acc2b3949f28 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:44.379021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff009a-cf26-4f3a-b443-acc2b3949f28 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:44.379658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff009a-cf26-4f3a-b443-acc2b3949f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:44.426690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fa6a6d279c4ed88f26062adfe2d3c6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:44.442953 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-82ff009a-cf26-4f3a-b443-acc2b3949f28 None None] MFA Rules not processed for user `8088799006474cbbb6ddf6544ce0b43b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:44.444422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-82ff009a-cf26-4f3a-b443-acc2b3949f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:44.448392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fa6a6d279c4ed88f26062adfe2d3c6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:44.450188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fa6a6d279c4ed88f26062adfe2d3c6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:44.453336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fa6a6d279c4ed88f26062adfe2d3c6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:44.468722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fa6a6d279c4ed88f26062adfe2d3c6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:44.535143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 855/1703] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:44.537506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc39f4-06a7-41e2-af4d-8f99633bee06 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:44.537793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc39f4-06a7-41e2-af4d-8f99633bee06 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:44.538867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc39f4-06a7-41e2-af4d-8f99633bee06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:44.543153 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 849/1704] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:43 2022] DELETE /identity/v3/users/79fa6a6d279c4ed88f26062adfe2d3c6 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:44.543153 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:44.543935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:44.594976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-77fc39f4-06a7-41e2-af4d-8f99633bee06 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:44.596216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-77fc39f4-06a7-41e2-af4d-8f99633bee06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:44.653644 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:44.672446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:44.702421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13de174-a239-4b27-b9e7-f8e5ba0158c8 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:44.713267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5dcc3-b5ea-46fc-a157-d0f1ce4bd5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:44.714179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5dcc3-b5ea-46fc-a157-d0f1ce4bd5db admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:44.714460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5dcc3-b5ea-46fc-a157-d0f1ce4bd5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:44.714730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5dcc3-b5ea-46fc-a157-d0f1ce4bd5db admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:44.722279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5dcc3-b5ea-46fc-a157-d0f1ce4bd5db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:44.728883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5dcc3-b5ea-46fc-a157-d0f1ce4bd5db admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:44.741311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 856/1705] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:44.742743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc39f4-06a7-41e2-af4d-8f99633bee06 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:44.744336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-77fc39f4-06a7-41e2-af4d-8f99633bee06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:44.771824 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc39f4-06a7-41e2-af4d-8f99633bee06 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:44.778913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44cf3a-0e38-4ee0-8aab-003c6a193484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:44.780014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44cf3a-0e38-4ee0-8aab-003c6a193484 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:44.780338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44cf3a-0e38-4ee0-8aab-003c6a193484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:44.781129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44cf3a-0e38-4ee0-8aab-003c6a193484 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:44.782019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44cf3a-0e38-4ee0-8aab-003c6a193484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:44.789589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 850/1706] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:44 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:44.789589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b617b93-6dce-49a0-b799-b67fbc5004c6 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:44.789589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b617b93-6dce-49a0-b799-b67fbc5004c6 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:44.789589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b617b93-6dce-49a0-b799-b67fbc5004c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:44.790402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44cf3a-0e38-4ee0-8aab-003c6a193484 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:44.814313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-3b617b93-6dce-49a0-b799-b67fbc5004c6 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:44.815650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3b617b93-6dce-49a0-b799-b67fbc5004c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:44.827052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 851/1707] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:44.828280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3abe37-06eb-476e-83f1-f959158cec8c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:44.828659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3abe37-06eb-476e-83f1-f959158cec8c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:44.828952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3abe37-06eb-476e-83f1-f959158cec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:44.831881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 857/1708] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:44 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:44.833679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44cf3a-0e38-4ee0-8aab-003c6a193484 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:44.835606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8b44cf3a-0e38-4ee0-8aab-003c6a193484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:44.866932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ca3abe37-06eb-476e-83f1-f959158cec8c None None] MFA Rules not processed for user `7a22b52fdd5b46229d7306086ae11738`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:44.868533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ca3abe37-06eb-476e-83f1-f959158cec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:44.936691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44cf3a-0e38-4ee0-8aab-003c6a193484 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:44.959712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e0b24-0af7-4b97-a6dd-0995ad387836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:44.960663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e0b24-0af7-4b97-a6dd-0995ad387836 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:44.960931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e0b24-0af7-4b97-a6dd-0995ad387836 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:44.961875 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e0b24-0af7-4b97-a6dd-0995ad387836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.082695 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 852/1709] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:45.083595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3abe37-06eb-476e-83f1-f959158cec8c None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:45.149562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e0b24-0af7-4b97-a6dd-0995ad387836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:45.151874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e0b24-0af7-4b97-a6dd-0995ad387836 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:45.200675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 858/1710] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:45.203116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e0b24-0af7-4b97-a6dd-0995ad387836 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:45.229358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e0b24-0af7-4b97-a6dd-0995ad387836 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:45.254152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17229354-1304-4d51-8d7b-c79cb2733240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:45.254902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17229354-1304-4d51-8d7b-c79cb2733240 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:45.255091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17229354-1304-4d51-8d7b-c79cb2733240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:45.255333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17229354-1304-4d51-8d7b-c79cb2733240 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.256913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17229354-1304-4d51-8d7b-c79cb2733240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:45.274301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17229354-1304-4d51-8d7b-c79cb2733240 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:45.294771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3abe37-06eb-476e-83f1-f959158cec8c None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:45.315652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb98a0-71b4-4c02-a68a-f2d07b7a93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:45.316284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb98a0-71b4-4c02-a68a-f2d07b7a93ce admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:45.316564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb98a0-71b4-4c02-a68a-f2d07b7a93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:45.316870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb98a0-71b4-4c02-a68a-f2d07b7a93ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.317519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb98a0-71b4-4c02-a68a-f2d07b7a93ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:45.319169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb98a0-71b4-4c02-a68a-f2d07b7a93ce admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:45.353647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 853/1711] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:45.354539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb98a0-71b4-4c02-a68a-f2d07b7a93ce admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:45.366812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 859/1712] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:45 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:45.374605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21121a29-40fd-48b6-8a4a-1a25992a0bca None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:45.375416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21121a29-40fd-48b6-8a4a-1a25992a0bca None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:45.381952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21121a29-40fd-48b6-8a4a-1a25992a0bca None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.385404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 860/1713] 10.222.0.25 () {54 vars in 912 bytes} [Tue Aug 9 12:21:45 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:45.389944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e38b-cc10-44b3-87f9-b9c9896e3e19 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:45.390446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e38b-cc10-44b3-87f9-b9c9896e3e19 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:45.390720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e38b-cc10-44b3-87f9-b9c9896e3e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.416183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb98a0-71b4-4c02-a68a-f2d07b7a93ce admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:45.446464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42584f4-4755-4464-bd7c-491e9bdfcb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:45.448843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42584f4-4755-4464-bd7c-491e9bdfcb24 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:45.452466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42584f4-4755-4464-bd7c-491e9bdfcb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:45.452945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42584f4-4755-4464-bd7c-491e9bdfcb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.454741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8395e38b-cc10-44b3-87f9-b9c9896e3e19 None None] MFA Rules not processed for user `7a22b52fdd5b46229d7306086ae11738`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:45.462563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8395e38b-cc10-44b3-87f9-b9c9896e3e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:45.487357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42584f4-4755-4464-bd7c-491e9bdfcb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:45.489319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42584f4-4755-4464-bd7c-491e9bdfcb24 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:45.490587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 861/1714] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:45.505477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395e38b-cc10-44b3-87f9-b9c9896e3e19 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:45.559611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395e38b-cc10-44b3-87f9-b9c9896e3e19 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:45.562337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 854/1715] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:45.563948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42584f4-4755-4464-bd7c-491e9bdfcb24 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:45.571967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87904855-c7ff-408d-8450-f56e96336ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:45.572952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87904855-c7ff-408d-8450-f56e96336ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:45.573544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87904855-c7ff-408d-8450-f56e96336ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:45.573966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87904855-c7ff-408d-8450-f56e96336ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.575381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87904855-c7ff-408d-8450-f56e96336ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:45.606831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87904855-c7ff-408d-8450-f56e96336ee1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:45.625249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42584f4-4755-4464-bd7c-491e9bdfcb24 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:45.644079 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b940412-9891-422c-8685-585a17e25902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:45.644995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940412-9891-422c-8685-585a17e25902 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:45.645277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940412-9891-422c-8685-585a17e25902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:45.645598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940412-9891-422c-8685-585a17e25902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.646469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b940412-9891-422c-8685-585a17e25902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:45.648546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b940412-9891-422c-8685-585a17e25902 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:45.650649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 862/1716] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:45.654828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ae061-bef8-4745-9c29-3d5339b8c966 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:45.655962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ae061-bef8-4745-9c29-3d5339b8c966 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:45.657204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ae061-bef8-4745-9c29-3d5339b8c966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.671300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 855/1717] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:45.672471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b940412-9891-422c-8685-585a17e25902 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:45.677527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2b940412-9891-422c-8685-585a17e25902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:45.742361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:45.805121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6c1ae061-bef8-4745-9c29-3d5339b8c966 None None] MFA Rules not processed for user `13063cbf860c4ca98666500c3c125933`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:45.806883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6c1ae061-bef8-4745-9c29-3d5339b8c966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:45.833367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 863/1718] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:21:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:45.834455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ae061-bef8-4745-9c29-3d5339b8c966 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:45.834645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b940412-9891-422c-8685-585a17e25902 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:45.849021 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914eebc-fed0-4ede-9ddf-5bc90f2d2040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:45.849890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914eebc-fed0-4ede-9ddf-5bc90f2d2040 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:45.850735 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914eebc-fed0-4ede-9ddf-5bc90f2d2040 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:45.851008 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914eebc-fed0-4ede-9ddf-5bc90f2d2040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.854481 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:45.867898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ae061-bef8-4745-9c29-3d5339b8c966 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:45.883736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcc973-4048-44e1-a18e-ff2de7b98608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:45.885431 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcc973-4048-44e1-a18e-ff2de7b98608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:45.887624 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcc973-4048-44e1-a18e-ff2de7b98608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:45.888782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914eebc-fed0-4ede-9ddf-5bc90f2d2040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:45.889150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcc973-4048-44e1-a18e-ff2de7b98608 admin admin] PATH_INFO: `/v3/projects/f66ea1149b67480bb5d344a4dd9a0c28/users/b37f762c495044d991309e1c33adec97/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:45.894340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914eebc-fed0-4ede-9ddf-5bc90f2d2040 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:45.931395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 856/1719] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:45.934069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914eebc-fed0-4ede-9ddf-5bc90f2d2040 service nova] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:45.958754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcc973-4048-44e1-a18e-ff2de7b98608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66ea1149b67480bb5d344a4dd9a0c28, user_id=b37f762c495044d991309e1c33adec97, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:45.962932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcc973-4048-44e1-a18e-ff2de7b98608 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:45.981633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914eebc-fed0-4ede-9ddf-5bc90f2d2040 service nova] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:45.995896 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10760914-40cb-424f-ba30-25a5609832bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:45.999568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10760914-40cb-424f-ba30-25a5609832bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:46.002725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10760914-40cb-424f-ba30-25a5609832bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:46.002938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10760914-40cb-424f-ba30-25a5609832bf admin admin] PATH_INFO: `/v3/projects/bcad661386fe4397a0b67f73ac30120b/users/8baeafb4cca6472795e87d0507de27a3/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:46.016063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 864/1720] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:45 2022] PUT /identity/v3/projects/f66ea1149b67480bb5d344a4dd9a0c28/users/b37f762c495044d991309e1c33adec97/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:46.016939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcc973-4048-44e1-a18e-ff2de7b98608 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:46.042257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10760914-40cb-424f-ba30-25a5609832bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcad661386fe4397a0b67f73ac30120b, user_id=8baeafb4cca6472795e87d0507de27a3, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:46.046271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10760914-40cb-424f-ba30-25a5609832bf admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:46.095158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 857/1721] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:45 2022] PUT /identity/v3/projects/bcad661386fe4397a0b67f73ac30120b/users/8baeafb4cca6472795e87d0507de27a3/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:46.097503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750ae99-88f3-4169-9502-cdbe23b73d61 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:46.105809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750ae99-88f3-4169-9502-cdbe23b73d61 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:46.106686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750ae99-88f3-4169-9502-cdbe23b73d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:46.179851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcc973-4048-44e1-a18e-ff2de7b98608 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:46.181002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-7750ae99-88f3-4169-9502-cdbe23b73d61 None None] MFA Rules not processed for user `b37f762c495044d991309e1c33adec97`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:46.182574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-7750ae99-88f3-4169-9502-cdbe23b73d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:46.332289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 858/1722] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:46.332289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750ae99-88f3-4169-9502-cdbe23b73d61 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:46.351714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce75ed-7461-4d2a-95a9-f3cd7a26fc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:46.354029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce75ed-7461-4d2a-95a9-f3cd7a26fc13 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:46.354316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce75ed-7461-4d2a-95a9-f3cd7a26fc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:46.354589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce75ed-7461-4d2a-95a9-f3cd7a26fc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:46.382342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce75ed-7461-4d2a-95a9-f3cd7a26fc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:46.386133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce75ed-7461-4d2a-95a9-f3cd7a26fc13 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:46.410672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 865/1723] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:46.415936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce75ed-7461-4d2a-95a9-f3cd7a26fc13 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:46.420648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-89ce75ed-7461-4d2a-95a9-f3cd7a26fc13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:46.541171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750ae99-88f3-4169-9502-cdbe23b73d61 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:46.565878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eeade-35b2-437f-896e-c34e0f0653f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:46.566521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eeade-35b2-437f-896e-c34e0f0653f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:46.566805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eeade-35b2-437f-896e-c34e0f0653f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:46.567080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eeade-35b2-437f-896e-c34e0f0653f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:46.568810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eeade-35b2-437f-896e-c34e0f0653f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:46.570620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eeade-35b2-437f-896e-c34e0f0653f0 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:46.601120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 859/1724] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:46.602051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eeade-35b2-437f-896e-c34e0f0653f0 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:46.622706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce75ed-7461-4d2a-95a9-f3cd7a26fc13 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:46.623967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eeade-35b2-437f-896e-c34e0f0653f0 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:46.633965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:46.635207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:46.635485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:46.635756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] PATH_INFO: `/v3/projects/9f6752ca2b8643f39976335a817afae5` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:46.637046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6752ca2b8643f39976335a817afae5)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:46.639584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e650b4-3524-44fe-82c3-904b3a4d317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:46.640207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e650b4-3524-44fe-82c3-904b3a4d317d admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:46.640473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e650b4-3524-44fe-82c3-904b3a4d317d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:46.640881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e650b4-3524-44fe-82c3-904b3a4d317d admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:46.641516 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e650b4-3524-44fe-82c3-904b3a4d317d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:46.643503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e650b4-3524-44fe-82c3-904b3a4d317d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:46.646192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:46.689262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:46.715114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 860/1725] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:46 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:46.720246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9b376-58c5-4d76-8731-fc0a6fe3f3eb None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:46.720542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9b376-58c5-4d76-8731-fc0a6fe3f3eb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:46.721303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9b376-58c5-4d76-8731-fc0a6fe3f3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:46.759926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:46.789085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6752ca2b8643f39976335a817afae5', 'request_id': 'req-216586bb-9180-4abf-8918-9b0091c8a52c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:46.804617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6752ca2b8643f39976335a817afae5', 'request_id': 'req-216586bb-9180-4abf-8918-9b0091c8a52c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:46.805270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-76a9b376-58c5-4d76-8731-fc0a6fe3f3eb None None] MFA Rules not processed for user `fcedc1966e19490fb739046a3379b135`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:46.808049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-76a9b376-58c5-4d76-8731-fc0a6fe3f3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:46.834462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6752ca2b8643f39976335a817afae5', 'request_id': 'req-216586bb-9180-4abf-8918-9b0091c8a52c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:46.868325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] The token cache is being invalidate because project 9f6752ca2b8643f39976335a817afae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:46.868974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:46.875331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:46.878312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 866/1726] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:46 2022] DELETE /identity/v3/projects/9f6752ca2b8643f39976335a817afae5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:46.880269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:46.888255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:47.009235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 861/1727] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:47.009235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9b376-58c5-4d76-8731-fc0a6fe3f3eb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:47.011604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-76a9b376-58c5-4d76-8731-fc0a6fe3f3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:47.083294 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216586bb-9180-4abf-8918-9b0091c8a52c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:47.094656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:47.096443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:47.097066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:47.097726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] PATH_INFO: `/v3/projects/5a5f5e9b58c84670855dce1b943514e0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:47.100225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5f5e9b58c84670855dce1b943514e0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:47.132185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:47.193483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9b376-58c5-4d76-8731-fc0a6fe3f3eb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:47.203771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b5a05-34be-4f77-8dfd-236a10aee7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:47.205297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5a05-34be-4f77-8dfd-236a10aee7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:47.205596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5a05-34be-4f77-8dfd-236a10aee7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:47.205868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5a05-34be-4f77-8dfd-236a10aee7e4 admin admin] PATH_INFO: `/v3/projects/bcad661386fe4397a0b67f73ac30120b/users/8baeafb4cca6472795e87d0507de27a3/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:47.213436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b5a05-34be-4f77-8dfd-236a10aee7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcad661386fe4397a0b67f73ac30120b, user_id=8baeafb4cca6472795e87d0507de27a3, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:47.217651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b5a05-34be-4f77-8dfd-236a10aee7e4 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:47.268914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 862/1728] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:47 2022] PUT /identity/v3/projects/bcad661386fe4397a0b67f73ac30120b/users/8baeafb4cca6472795e87d0507de27a3/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:47.271792 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b5a05-34be-4f77-8dfd-236a10aee7e4 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:47.273782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5f5e9b58c84670855dce1b943514e0', 'request_id': 'req-0d5c3714-bfe8-4160-a684-5256a74431c9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:47.275585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c93b5a05-34be-4f77-8dfd-236a10aee7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:47.314551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5f5e9b58c84670855dce1b943514e0', 'request_id': 'req-0d5c3714-bfe8-4160-a684-5256a74431c9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:47.327704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5f5e9b58c84670855dce1b943514e0', 'request_id': 'req-0d5c3714-bfe8-4160-a684-5256a74431c9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:47.380108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] The token cache is being invalidate because project 5a5f5e9b58c84670855dce1b943514e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:47.380508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:47.382488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:47.390713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 867/1729] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:46 2022] DELETE /identity/v3/projects/5a5f5e9b58c84670855dce1b943514e0 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:47.391701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:47.412843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:47.474119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b5a05-34be-4f77-8dfd-236a10aee7e4 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:47.479684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b57c6-bd72-41d7-876f-9c032c54970a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:47.480309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b57c6-bd72-41d7-876f-9c032c54970a admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:47.481190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b57c6-bd72-41d7-876f-9c032c54970a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:47.481461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b57c6-bd72-41d7-876f-9c032c54970a admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:47.482873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b57c6-bd72-41d7-876f-9c032c54970a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:47.493497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b57c6-bd72-41d7-876f-9c032c54970a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:47.524125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 863/1730] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:47 2022] POST /identity/v3/users => generated 300 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:47.526330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ed94d-7a86-4e7d-8991-950e1721b173 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:47.527007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ed94d-7a86-4e7d-8991-950e1721b173 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:47.528107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ed94d-7a86-4e7d-8991-950e1721b173 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:47.530042 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 864/1731] 10.222.0.25 () {54 vars in 912 bytes} [Tue Aug 9 12:21:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:47.531905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee476-bc7d-4a48-9a8e-f274a8b3bbba None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:47.532577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee476-bc7d-4a48-9a8e-f274a8b3bbba None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:47.533124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee476-bc7d-4a48-9a8e-f274a8b3bbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:47.559320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c3714-bfe8-4160-a684-5256a74431c9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:47.567724 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:47.569005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:47.571600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:47.572147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] PATH_INFO: `/v3/users/05144d2afb3643aabbed2e03f0c5d6f6` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:47.574316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05144d2afb3643aabbed2e03f0c5d6f6)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:47.581292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:47.584655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:47.623914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-f40ee476-bc7d-4a48-9a8e-f274a8b3bbba None None] MFA Rules not processed for user `8baeafb4cca6472795e87d0507de27a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:47.625180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f40ee476-bc7d-4a48-9a8e-f274a8b3bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:47.677783 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:47.724785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05144d2afb3643aabbed2e03f0c5d6f6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:47.753176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05144d2afb3643aabbed2e03f0c5d6f6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:47.758402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05144d2afb3643aabbed2e03f0c5d6f6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:47.759569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05144d2afb3643aabbed2e03f0c5d6f6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:47.782886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-158b1296-e1c5-420c-a6d5-ddc3e39a469c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05144d2afb3643aabbed2e03f0c5d6f6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:47.832231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 868/1732] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:47 2022] DELETE /identity/v3/users/05144d2afb3643aabbed2e03f0c5d6f6 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:47.834356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0838a-9529-4622-9857-3ead626b1246 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:47.834639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0838a-9529-4622-9857-3ead626b1246 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:47.837202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0838a-9529-4622-9857-3ead626b1246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:47.888707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-80b0838a-9529-4622-9857-3ead626b1246 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:47.889966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-80b0838a-9529-4622-9857-3ead626b1246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:47.908524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 865/1733] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:47.910689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ee476-bc7d-4a48-9a8e-f274a8b3bbba None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:47.914957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f40ee476-bc7d-4a48-9a8e-f274a8b3bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:47.959270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ee476-bc7d-4a48-9a8e-f274a8b3bbba None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:48.073907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 869/1734] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:48.076876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324b3f-19df-4aba-b37e-f561899a6bc6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.077228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324b3f-19df-4aba-b37e-f561899a6bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.077479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324b3f-19df-4aba-b37e-f561899a6bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.129943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-10324b3f-19df-4aba-b37e-f561899a6bc6 None None] MFA Rules not processed for user `13063cbf860c4ca98666500c3c125933`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:48.132753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-10324b3f-19df-4aba-b37e-f561899a6bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:48.139676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbe612-7c9d-4616-9655-0d28532b5c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:48.146581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbe612-7c9d-4616-9655-0d28532b5c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.146940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbe612-7c9d-4616-9655-0d28532b5c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.147969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbe612-7c9d-4616-9655-0d28532b5c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.148556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbe612-7c9d-4616-9655-0d28532b5c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:48.150475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbe612-7c9d-4616-9655-0d28532b5c5d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:48.167231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 866/1735] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:48.168879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb5477-d396-4c60-8e95-f83121315aa9 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.169169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb5477-d396-4c60-8e95-f83121315aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.169445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb5477-d396-4c60-8e95-f83121315aa9 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.177322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 867/1736] 10.222.0.25 () {54 vars in 961 bytes} [Tue Aug 9 12:21:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:48.178428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb5477-d396-4c60-8e95-f83121315aa9 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:48.181495 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-abeb5477-d396-4c60-8e95-f83121315aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:48.274463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 870/1737] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:48.279822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4676-a2a8-4541-9572-6d17c9f6ab86 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.280125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4676-a2a8-4541-9572-6d17c9f6ab86 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.282311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4676-a2a8-4541-9572-6d17c9f6ab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.323905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb5477-d396-4c60-8e95-f83121315aa9 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:48.328541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74fd1e-cb2f-4ec0-bf74-c20ffae6fbe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:48.329415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74fd1e-cb2f-4ec0-bf74-c20ffae6fbe1 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.329534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74fd1e-cb2f-4ec0-bf74-c20ffae6fbe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.330743 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74fd1e-cb2f-4ec0-bf74-c20ffae6fbe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.334086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fd8e4676-a2a8-4541-9572-6d17c9f6ab86 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:48.336400 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fd8e4676-a2a8-4541-9572-6d17c9f6ab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:48.363670 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 871/1738] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:48.365264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e4676-a2a8-4541-9572-6d17c9f6ab86 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:48.389947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e4676-a2a8-4541-9572-6d17c9f6ab86 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:48.409959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936974a-469a-4377-a45f-5c185d4bc7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:48.410839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936974a-469a-4377-a45f-5c185d4bc7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.411291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936974a-469a-4377-a45f-5c185d4bc7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.411744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936974a-469a-4377-a45f-5c185d4bc7ea admin admin] PATH_INFO: `/v3/projects/f6a6e47d62fe46ce892dbb99365057bb/users/0fb78a291cd943a6bd3ef3236b9683bf/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.460134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936974a-469a-4377-a45f-5c185d4bc7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a6e47d62fe46ce892dbb99365057bb, user_id=0fb78a291cd943a6bd3ef3236b9683bf, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:48.463077 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936974a-469a-4377-a45f-5c185d4bc7ea admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:48.474606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74fd1e-cb2f-4ec0-bf74-c20ffae6fbe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:48.476768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74fd1e-cb2f-4ec0-bf74-c20ffae6fbe1 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:48.485927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:48.499795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:48.506335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 872/1739] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:48 2022] PUT /identity/v3/projects/f6a6e47d62fe46ce892dbb99365057bb/users/0fb78a291cd943a6bd3ef3236b9683bf/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:48.511154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8b1a0-c389-4bbd-8f68-422a1cc4f14f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.511446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8b1a0-c389-4bbd-8f68-422a1cc4f14f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.511794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8b1a0-c389-4bbd-8f68-422a1cc4f14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.530638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 868/1740] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:48.532489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74fd1e-cb2f-4ec0-bf74-c20ffae6fbe1 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:48.561251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e9a8b1a0-c389-4bbd-8f68-422a1cc4f14f None None] MFA Rules not processed for user `c7f2e22ace8648919104c910c74c1711`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:48.562728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e9a8b1a0-c389-4bbd-8f68-422a1cc4f14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:48.573961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74fd1e-cb2f-4ec0-bf74-c20ffae6fbe1 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:48.711653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 873/1741] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Aug 9 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:48.712549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8b1a0-c389-4bbd-8f68-422a1cc4f14f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:48.715914 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e9a8b1a0-c389-4bbd-8f68-422a1cc4f14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:48.741957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662e931-313d-49ec-9205-7670d3fe345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:48.742576 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e931-313d-49ec-9205-7670d3fe345f admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.743005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e931-313d-49ec-9205-7670d3fe345f admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.745126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e931-313d-49ec-9205-7670d3fe345f admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.748038 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662e931-313d-49ec-9205-7670d3fe345f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:48.748413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662e931-313d-49ec-9205-7670d3fe345f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:48.755766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662e931-313d-49ec-9205-7670d3fe345f admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:48.785209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 869/1742] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:48.786230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662e931-313d-49ec-9205-7670d3fe345f admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:48.807760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8b1a0-c389-4bbd-8f68-422a1cc4f14f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:48.811024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662e931-313d-49ec-9205-7670d3fe345f admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:48.816475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cde76a-977d-49b0-9426-5fdf1cc3ab7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:48.817164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cde76a-977d-49b0-9426-5fdf1cc3ab7f service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.817518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cde76a-977d-49b0-9426-5fdf1cc3ab7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.817864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cde76a-977d-49b0-9426-5fdf1cc3ab7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.817961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be9813-1ce0-4ab4-b827-120a31d99164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:48.818686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be9813-1ce0-4ab4-b827-120a31d99164 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.819130 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be9813-1ce0-4ab4-b827-120a31d99164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.819457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be9813-1ce0-4ab4-b827-120a31d99164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.820163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be9813-1ce0-4ab4-b827-120a31d99164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:48.822018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be9813-1ce0-4ab4-b827-120a31d99164 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:48.835633 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cde76a-977d-49b0-9426-5fdf1cc3ab7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:48.840919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 870/1743] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:48.840919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be9813-1ce0-4ab4-b827-120a31d99164 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:48.841135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cde76a-977d-49b0-9426-5fdf1cc3ab7f service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:48.842064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e1be9813-1ce0-4ab4-b827-120a31d99164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:48.852512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 874/1744] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:48.854155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cde76a-977d-49b0-9426-5fdf1cc3ab7f service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:48.859247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be9813-1ce0-4ab4-b827-120a31d99164 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:48.873647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:48.874449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:48.874822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:48.875182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] PATH_INFO: `/v3/projects/b6ac8acbd95c4e1fa5cd27ad2685d3df` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:48.876544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ac8acbd95c4e1fa5cd27ad2685d3df)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:48.880270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:48.961492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ac8acbd95c4e1fa5cd27ad2685d3df', 'request_id': 'req-b2b5978a-4833-4c43-851a-1dc1eb007155'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:48.971733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ac8acbd95c4e1fa5cd27ad2685d3df', 'request_id': 'req-b2b5978a-4833-4c43-851a-1dc1eb007155'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:48.977689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cde76a-977d-49b0-9426-5fdf1cc3ab7f service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:48.987530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ac8acbd95c4e1fa5cd27ad2685d3df', 'request_id': 'req-b2b5978a-4833-4c43-851a-1dc1eb007155'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:49.014557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] The token cache is being invalidate because project b6ac8acbd95c4e1fa5cd27ad2685d3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:49.016043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:49.018557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:49.023343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 871/1745] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:48 2022] DELETE /identity/v3/projects/b6ac8acbd95c4e1fa5cd27ad2685d3df => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:49.024045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:49.028518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:49.163776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0958b7-43e2-44f6-a895-faa3112bf01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:49.164568 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0958b7-43e2-44f6-a895-faa3112bf01a service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:49.164881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0958b7-43e2-44f6-a895-faa3112bf01a service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:49.165426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0958b7-43e2-44f6-a895-faa3112bf01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:49.169413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4c0958b7-43e2-44f6-a895-faa3112bf01a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:49.194097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:49.216288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5978a-4833-4c43-851a-1dc1eb007155 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:49.235664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ece4f-feec-4c60-9c2d-e971f02da5e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:49.236851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ece4f-feec-4c60-9c2d-e971f02da5e2 service placement] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:49.237329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ece4f-feec-4c60-9c2d-e971f02da5e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:49.237846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ece4f-feec-4c60-9c2d-e971f02da5e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:49.240002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e74ece4f-feec-4c60-9c2d-e971f02da5e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:49.251804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:49.259349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ece4f-feec-4c60-9c2d-e971f02da5e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:49.263374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ece4f-feec-4c60-9c2d-e971f02da5e2 service placement] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:49.286057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 872/1746] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:49.288282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ece4f-feec-4c60-9c2d-e971f02da5e2 service placement] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:49.291518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e74ece4f-feec-4c60-9c2d-e971f02da5e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:49.358395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0958b7-43e2-44f6-a895-faa3112bf01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:49.361072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0958b7-43e2-44f6-a895-faa3112bf01a service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:49.398409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 875/1747] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:49.399253 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0958b7-43e2-44f6-a895-faa3112bf01a service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:49.401020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4c0958b7-43e2-44f6-a895-faa3112bf01a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:49.469270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ece4f-feec-4c60-9c2d-e971f02da5e2 service placement] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:49.484167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbea6cc-45cc-4fba-8525-abd31d4619c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:49.484808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbea6cc-45cc-4fba-8525-abd31d4619c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:49.485312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbea6cc-45cc-4fba-8525-abd31d4619c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:49.485593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbea6cc-45cc-4fba-8525-abd31d4619c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:49.486224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbea6cc-45cc-4fba-8525-abd31d4619c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:49.490166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbea6cc-45cc-4fba-8525-abd31d4619c6 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:49.534055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0958b7-43e2-44f6-a895-faa3112bf01a service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:49.540603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1a84c-0bed-4ad3-bbe1-7aabfcb51eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:49.541898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1a84c-0bed-4ad3-bbe1-7aabfcb51eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:49.542874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1a84c-0bed-4ad3-bbe1-7aabfcb51eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:49.544387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1a84c-0bed-4ad3-bbe1-7aabfcb51eb5 admin admin] PATH_INFO: `/v3/projects/f6a6e47d62fe46ce892dbb99365057bb/users/0fb78a291cd943a6bd3ef3236b9683bf/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:49.548279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1a84c-0bed-4ad3-bbe1-7aabfcb51eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a6e47d62fe46ce892dbb99365057bb, user_id=0fb78a291cd943a6bd3ef3236b9683bf, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:49.557269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1a84c-0bed-4ad3-bbe1-7aabfcb51eb5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:49.590508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 873/1749] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:49 2022] POST /identity/v3/projects => generated 373 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:49.590508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2d547-f4bf-4608-839a-1081f131f470 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:49.590508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2d547-f4bf-4608-839a-1081f131f470 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:49.590508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2d547-f4bf-4608-839a-1081f131f470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:49.592364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 876/1749] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:49 2022] PUT /identity/v3/projects/f6a6e47d62fe46ce892dbb99365057bb/users/0fb78a291cd943a6bd3ef3236b9683bf/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:49.593850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1a84c-0bed-4ad3-bbe1-7aabfcb51eb5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:49.596116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9da1a84c-0bed-4ad3-bbe1-7aabfcb51eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:49.642263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9cd2d547-f4bf-4608-839a-1081f131f470 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:49.643512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9cd2d547-f4bf-4608-839a-1081f131f470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:49.806147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1a84c-0bed-4ad3-bbe1-7aabfcb51eb5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:49.869876 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 874/1750] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:49.879258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2d547-f4bf-4608-839a-1081f131f470 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:49.917501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2d547-f4bf-4608-839a-1081f131f470 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:49.938970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff711c09-243a-4c40-834c-2f91ba6e223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:49.943076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff711c09-243a-4c40-834c-2f91ba6e223d admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:49.943367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff711c09-243a-4c40-834c-2f91ba6e223d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:49.943642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff711c09-243a-4c40-834c-2f91ba6e223d admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:49.944592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff711c09-243a-4c40-834c-2f91ba6e223d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:49.952003 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff711c09-243a-4c40-834c-2f91ba6e223d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:49.989907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:50.023692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 875/1751] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:49 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:50.025167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d4a52-13f0-4027-b762-c9b9a756c5e1 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.025457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d4a52-13f0-4027-b762-c9b9a756c5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.025728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d4a52-13f0-4027-b762-c9b9a756c5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.081817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac293d-e11e-48a9-af7e-65a90978b4ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.082474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac293d-e11e-48a9-af7e-65a90978b4ca service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.082717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac293d-e11e-48a9-af7e-65a90978b4ca service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.082987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac293d-e11e-48a9-af7e-65a90978b4ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.104658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac293d-e11e-48a9-af7e-65a90978b4ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.106317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac293d-e11e-48a9-af7e-65a90978b4ca service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.123983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-531d4a52-13f0-4027-b762-c9b9a756c5e1 None None] MFA Rules not processed for user `0fb78a291cd943a6bd3ef3236b9683bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.126350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-531d4a52-13f0-4027-b762-c9b9a756c5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.130453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 877/1752] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:50.147399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b9f5-4887-4abb-9ad0-ab561decadd8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.147679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b9f5-4887-4abb-9ad0-ab561decadd8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.147952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b9f5-4887-4abb-9ad0-ab561decadd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.215497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d896b9f5-4887-4abb-9ad0-ab561decadd8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.217849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d896b9f5-4887-4abb-9ad0-ab561decadd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.228441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 878/1753] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:50.230478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b9f5-4887-4abb-9ad0-ab561decadd8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.267118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:50.274553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b9f5-4887-4abb-9ad0-ab561decadd8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.291173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b94b97-c2f8-4dea-961e-d87e239c0fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.291912 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b94b97-c2f8-4dea-961e-d87e239c0fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.292296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b94b97-c2f8-4dea-961e-d87e239c0fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.292719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b94b97-c2f8-4dea-961e-d87e239c0fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.293634 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b94b97-c2f8-4dea-961e-d87e239c0fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.295469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b94b97-c2f8-4dea-961e-d87e239c0fe0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.329549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 876/1754] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:50.330281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d4a52-13f0-4027-b762-c9b9a756c5e1 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.352282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 879/1755] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:50.357555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca0b8-5b64-4f84-bb58-0193ebf9269c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.357555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca0b8-5b64-4f84-bb58-0193ebf9269c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.357831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca0b8-5b64-4f84-bb58-0193ebf9269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.363538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d4a52-13f0-4027-b762-c9b9a756c5e1 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.378047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188325a2-1885-40cb-8835-250119ec5aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.378684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188325a2-1885-40cb-8835-250119ec5aec admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.378966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188325a2-1885-40cb-8835-250119ec5aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.379239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188325a2-1885-40cb-8835-250119ec5aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.379906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188325a2-1885-40cb-8835-250119ec5aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:50.380202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188325a2-1885-40cb-8835-250119ec5aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.387669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188325a2-1885-40cb-8835-250119ec5aec admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.410870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-254ca0b8-5b64-4f84-bb58-0193ebf9269c None None] MFA Rules not processed for user `7a22b52fdd5b46229d7306086ae11738`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.415841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-254ca0b8-5b64-4f84-bb58-0193ebf9269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.429964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 877/1756] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:50.435482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188325a2-1885-40cb-8835-250119ec5aec admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.446829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-188325a2-1885-40cb-8835-250119ec5aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.619704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 880/1757] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:50.621039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ca0b8-5b64-4f84-bb58-0193ebf9269c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.661326 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188325a2-1885-40cb-8835-250119ec5aec admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.675013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ca0b8-5b64-4f84-bb58-0193ebf9269c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.675370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41179e6-be13-49cb-97c1-e2bc70443efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.676269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41179e6-be13-49cb-97c1-e2bc70443efe service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.676549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41179e6-be13-49cb-97c1-e2bc70443efe service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.677142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41179e6-be13-49cb-97c1-e2bc70443efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.691433 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b6d22-005e-4e0b-a249-f9e03de90aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.693024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6d22-005e-4e0b-a249-f9e03de90aba admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.695046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6d22-005e-4e0b-a249-f9e03de90aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.697488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6d22-005e-4e0b-a249-f9e03de90aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.698445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b6d22-005e-4e0b-a249-f9e03de90aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.702739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b6d22-005e-4e0b-a249-f9e03de90aba admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.713594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41179e6-be13-49cb-97c1-e2bc70443efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.715151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41179e6-be13-49cb-97c1-e2bc70443efe service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.738894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 881/1758] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:50.740999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b6d22-005e-4e0b-a249-f9e03de90aba admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.760651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 878/1759] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:50.761099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41179e6-be13-49cb-97c1-e2bc70443efe service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.774494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b6d22-005e-4e0b-a249-f9e03de90aba admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.787900 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41179e6-be13-49cb-97c1-e2bc70443efe service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.790153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d89725-4a49-45eb-8603-c19e706648b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.790994 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d89725-4a49-45eb-8603-c19e706648b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.791628 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d89725-4a49-45eb-8603-c19e706648b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.792049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d89725-4a49-45eb-8603-c19e706648b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.793444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d89725-4a49-45eb-8603-c19e706648b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.793646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e6167-d4da-4e58-a2c4-d959b35ea34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.794325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e6167-d4da-4e58-a2c4-d959b35ea34a admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.794605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e6167-d4da-4e58-a2c4-d959b35ea34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.794878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e6167-d4da-4e58-a2c4-d959b35ea34a admin admin] PATH_INFO: `/v3/projects/e0cd17d3bbc542cf8e010de1156b647a/users/6733d9d249784df1888d70a0f0308c31/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.796421 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d89725-4a49-45eb-8603-c19e706648b8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.846672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e6167-d4da-4e58-a2c4-d959b35ea34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cd17d3bbc542cf8e010de1156b647a, user_id=6733d9d249784df1888d70a0f0308c31, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.849743 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e6167-d4da-4e58-a2c4-d959b35ea34a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.877298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 879/1760] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:50 2022] PUT /identity/v3/projects/e0cd17d3bbc542cf8e010de1156b647a/users/6733d9d249784df1888d70a0f0308c31/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:50.878146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e6167-d4da-4e58-a2c4-d959b35ea34a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.893233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 882/1761] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:50.894661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa857a2-b5b0-4897-9503-ad48dfd1bef0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.894957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa857a2-b5b0-4897-9503-ad48dfd1bef0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.895238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa857a2-b5b0-4897-9503-ad48dfd1bef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.987036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bfa857a2-b5b0-4897-9503-ad48dfd1bef0 None None] MFA Rules not processed for user `6733d9d249784df1888d70a0f0308c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.988646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bfa857a2-b5b0-4897-9503-ad48dfd1bef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.093328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e6167-d4da-4e58-a2c4-d959b35ea34a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.205934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 883/1762] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:51.209284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa857a2-b5b0-4897-9503-ad48dfd1bef0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.270822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.275450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.275774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.276935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] PATH_INFO: `/v3/users/b37f762c495044d991309e1c33adec97` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.279052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37f762c495044d991309e1c33adec97)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.281332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.283236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:51.287010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:51.410023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37f762c495044d991309e1c33adec97'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:51.429632 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa857a2-b5b0-4897-9503-ad48dfd1bef0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.431909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37f762c495044d991309e1c33adec97'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:51.433167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37f762c495044d991309e1c33adec97'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:51.435483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37f762c495044d991309e1c33adec97'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:51.446820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd70a01-8634-4ef7-ad2e-f93c8c9b3cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.450183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd70a01-8634-4ef7-ad2e-f93c8c9b3cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.453685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd70a01-8634-4ef7-ad2e-f93c8c9b3cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.454653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd70a01-8634-4ef7-ad2e-f93c8c9b3cdc admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.456975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd70a01-8634-4ef7-ad2e-f93c8c9b3cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.462698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd70a01-8634-4ef7-ad2e-f93c8c9b3cdc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.463505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37f762c495044d991309e1c33adec97'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:51.538317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 880/1763] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:50 2022] DELETE /identity/v3/users/b37f762c495044d991309e1c33adec97 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:51.538317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.540064 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 884/1764] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/users => generated 284 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.542413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9fa19-b10b-429d-9add-c75aded73c08 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.543216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9fa19-b10b-429d-9add-c75aded73c08 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.543507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9fa19-b10b-429d-9add-c75aded73c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.543683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.633757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fba9fa19-b10b-429d-9add-c75aded73c08 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:51.634672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fba9fa19-b10b-429d-9add-c75aded73c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.762369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474582fe-ac81-48c8-ad97-d18a41c52546 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.778619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458c307-6fde-45fc-b59b-c4f7b68a3e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.779258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c307-6fde-45fc-b59b-c4f7b68a3e8b service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.779542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c307-6fde-45fc-b59b-c4f7b68a3e8b service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.779819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c307-6fde-45fc-b59b-c4f7b68a3e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.783624 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0458c307-6fde-45fc-b59b-c4f7b68a3e8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.787956 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 885/1765] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:51.791572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9fa19-b10b-429d-9add-c75aded73c08 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.791572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fba9fa19-b10b-429d-9add-c75aded73c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.821679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9fa19-b10b-429d-9add-c75aded73c08 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.842646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366da42-9a5f-4344-b244-dbafe735a250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.843179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366da42-9a5f-4344-b244-dbafe735a250 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.843461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366da42-9a5f-4344-b244-dbafe735a250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.843736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366da42-9a5f-4344-b244-dbafe735a250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.844612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366da42-9a5f-4344-b244-dbafe735a250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.846263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366da42-9a5f-4344-b244-dbafe735a250 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.886706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 886/1766] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:51.893345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366da42-9a5f-4344-b244-dbafe735a250 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.902024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4366da42-9a5f-4344-b244-dbafe735a250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.965786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458c307-6fde-45fc-b59b-c4f7b68a3e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.968741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458c307-6fde-45fc-b59b-c4f7b68a3e8b service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.987338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 881/1767] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:51.988193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458c307-6fde-45fc-b59b-c4f7b68a3e8b service nova] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.007908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458c307-6fde-45fc-b59b-c4f7b68a3e8b service nova] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.030269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd22f0-92fa-4d38-9e9d-1ce75c9de935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.031009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd22f0-92fa-4d38-9e9d-1ce75c9de935 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.031173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd22f0-92fa-4d38-9e9d-1ce75c9de935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.031435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd22f0-92fa-4d38-9e9d-1ce75c9de935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.032160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd22f0-92fa-4d38-9e9d-1ce75c9de935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.044110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd22f0-92fa-4d38-9e9d-1ce75c9de935 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.088038 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 882/1768] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.096871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd22f0-92fa-4d38-9e9d-1ce75c9de935 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.098389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366da42-9a5f-4344-b244-dbafe735a250 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.116389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf19cf-990e-42f9-8f63-c63defe53200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.117066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf19cf-990e-42f9-8f63-c63defe53200 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.117346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf19cf-990e-42f9-8f63-c63defe53200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.117615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf19cf-990e-42f9-8f63-c63defe53200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.124542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:52.144082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd22f0-92fa-4d38-9e9d-1ce75c9de935 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.170002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b32203-a1ec-43de-bff3-e86946059e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.170688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b32203-a1ec-43de-bff3-e86946059e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.170971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b32203-a1ec-43de-bff3-e86946059e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.171243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b32203-a1ec-43de-bff3-e86946059e11 admin admin] PATH_INFO: `/v3/projects/afc4fb386c1640d8b9e1d1290db04c26/users/23fbc37f644f44f5b51cbc1aad82cc3b/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.172185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf19cf-990e-42f9-8f63-c63defe53200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.175251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf19cf-990e-42f9-8f63-c63defe53200 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.213833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 887/1769] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:52.221028 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b32203-a1ec-43de-bff3-e86946059e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc4fb386c1640d8b9e1d1290db04c26, user_id=23fbc37f644f44f5b51cbc1aad82cc3b, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.223978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b32203-a1ec-43de-bff3-e86946059e11 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.270296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ffde4-fb01-4c8c-8221-75ad4eaecda8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.270901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ffde4-fb01-4c8c-8221-75ad4eaecda8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.271159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ffde4-fb01-4c8c-8221-75ad4eaecda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.278659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 883/1770] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:52 2022] PUT /identity/v3/projects/afc4fb386c1640d8b9e1d1290db04c26/users/23fbc37f644f44f5b51cbc1aad82cc3b/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:52.356964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-600ffde4-fb01-4c8c-8221-75ad4eaecda8 None None] MFA Rules not processed for user `23fbc37f644f44f5b51cbc1aad82cc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:52.360525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-600ffde4-fb01-4c8c-8221-75ad4eaecda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:52.477729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:52.612681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b32203-a1ec-43de-bff3-e86946059e11 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.629292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 888/1771] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:52.802048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b32203-a1ec-43de-bff3-e86946059e11 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.811262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c767ce-ae55-4f65-9569-1abcd60c5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.812015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c767ce-ae55-4f65-9569-1abcd60c5800 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.812334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c767ce-ae55-4f65-9569-1abcd60c5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.812612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c767ce-ae55-4f65-9569-1abcd60c5800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.813348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c767ce-ae55-4f65-9569-1abcd60c5800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.816029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c767ce-ae55-4f65-9569-1abcd60c5800 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.893861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ffde4-fb01-4c8c-8221-75ad4eaecda8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.895377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-600ffde4-fb01-4c8c-8221-75ad4eaecda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:52.897840 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 884/1772] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:52 2022] POST /identity/v3/projects => generated 367 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:52.900217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c767ce-ae55-4f65-9569-1abcd60c5800 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.913278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ffde4-fb01-4c8c-8221-75ad4eaecda8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.143918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c767ce-ae55-4f65-9569-1abcd60c5800 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.159777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b5ef9-0626-4bbb-a926-d21a6b457a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.162207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5ef9-0626-4bbb-a926-d21a6b457a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.162542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5ef9-0626-4bbb-a926-d21a6b457a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.162823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5ef9-0626-4bbb-a926-d21a6b457a26 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.165636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b5ef9-0626-4bbb-a926-d21a6b457a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.165770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.166592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.170052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.170667 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] PATH_INFO: `/v3/users/6733d9d249784df1888d70a0f0308c31` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.171170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b5ef9-0626-4bbb-a926-d21a6b457a26 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.175083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6733d9d249784df1888d70a0f0308c31)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.184996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.223816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 885/1773] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:52 2022] POST /identity/v3/users => generated 290 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:53.227835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b5ef9-0626-4bbb-a926-d21a6b457a26 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.273032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b5ef9-0626-4bbb-a926-d21a6b457a26 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.286356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeba7d9-ca02-4d52-98b0-ec2057f7ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.288322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeba7d9-ca02-4d52-98b0-ec2057f7ffd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.289100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeba7d9-ca02-4d52-98b0-ec2057f7ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.290203 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeba7d9-ca02-4d52-98b0-ec2057f7ffd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.291558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeba7d9-ca02-4d52-98b0-ec2057f7ffd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.294825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeba7d9-ca02-4d52-98b0-ec2057f7ffd5 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.330027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6733d9d249784df1888d70a0f0308c31'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:53.341391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 886/1774] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:53.346024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeba7d9-ca02-4d52-98b0-ec2057f7ffd5 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.352480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6733d9d249784df1888d70a0f0308c31'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:53.356327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6733d9d249784df1888d70a0f0308c31'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:53.357656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6733d9d249784df1888d70a0f0308c31'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:53.372083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeba7d9-ca02-4d52-98b0-ec2057f7ffd5 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.374522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6733d9d249784df1888d70a0f0308c31'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:53.387285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033386a-ca8a-4677-9cbb-d560ea513633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.388491 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033386a-ca8a-4677-9cbb-d560ea513633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.389563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033386a-ca8a-4677-9cbb-d560ea513633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.390015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033386a-ca8a-4677-9cbb-d560ea513633 admin admin] PATH_INFO: `/v3/projects/86547f7fd67444e0a898a7e7d2dc5ca2/users/985c6b0e329c4de58ddd206e42e9062b/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.430655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033386a-ca8a-4677-9cbb-d560ea513633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86547f7fd67444e0a898a7e7d2dc5ca2, user_id=985c6b0e329c4de58ddd206e42e9062b, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.435496 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 889/1775] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:52 2022] DELETE /identity/v3/users/6733d9d249784df1888d70a0f0308c31 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:53.435757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033386a-ca8a-4677-9cbb-d560ea513633 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.447562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.457852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:53.463700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 887/1776] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:53 2022] PUT /identity/v3/projects/86547f7fd67444e0a898a7e7d2dc5ca2/users/985c6b0e329c4de58ddd206e42e9062b/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:53.467559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8305f-8a55-452a-b812-96be4ac3b5ae None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.468805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8305f-8a55-452a-b812-96be4ac3b5ae None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.469026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8305f-8a55-452a-b812-96be4ac3b5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.543341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-02f8305f-8a55-452a-b812-96be4ac3b5ae None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:53.548153 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-02f8305f-8a55-452a-b812-96be4ac3b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:53.584936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:53.601334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:53.649908 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a7052-4864-4816-9b9f-e9f1a48655c7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.678385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 888/1777] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:53.679528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8305f-8a55-452a-b812-96be4ac3b5ae None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.681149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-02f8305f-8a55-452a-b812-96be4ac3b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:53.698075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8305f-8a55-452a-b812-96be4ac3b5ae None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.709976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019651e8-daba-49c3-a306-4d06b9d9b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.711564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019651e8-daba-49c3-a306-4d06b9d9b8df admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.711985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019651e8-daba-49c3-a306-4d06b9d9b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.713689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019651e8-daba-49c3-a306-4d06b9d9b8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.714541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019651e8-daba-49c3-a306-4d06b9d9b8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.720753 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019651e8-daba-49c3-a306-4d06b9d9b8df admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.747583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 889/1778] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:53.748555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019651e8-daba-49c3-a306-4d06b9d9b8df admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.754596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-019651e8-daba-49c3-a306-4d06b9d9b8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:53.781216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.781865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.782128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.782471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] PATH_INFO: `/v3/users/8088799006474cbbb6ddf6544ce0b43b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.784041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8088799006474cbbb6ddf6544ce0b43b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.796477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.867589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019651e8-daba-49c3-a306-4d06b9d9b8df admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.871787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14643fa9-60cd-4ec8-8114-6ff5eac32125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.872592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643fa9-60cd-4ec8-8114-6ff5eac32125 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.872907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643fa9-60cd-4ec8-8114-6ff5eac32125 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.873095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8088799006474cbbb6ddf6544ce0b43b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:53.873214 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643fa9-60cd-4ec8-8114-6ff5eac32125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.884334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14643fa9-60cd-4ec8-8114-6ff5eac32125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.885838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14643fa9-60cd-4ec8-8114-6ff5eac32125 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.894334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8088799006474cbbb6ddf6544ce0b43b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:53.897853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 890/1779] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:53.899638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14643fa9-60cd-4ec8-8114-6ff5eac32125 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.900231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8088799006474cbbb6ddf6544ce0b43b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:53.900961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8088799006474cbbb6ddf6544ce0b43b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:53.911093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14643fa9-60cd-4ec8-8114-6ff5eac32125 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.913530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f2c55452-3332-427b-9484-05fe71399e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8088799006474cbbb6ddf6544ce0b43b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:53.917375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb70ed-4841-4127-b344-db2cb2fa914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.918139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb70ed-4841-4127-b344-db2cb2fa914f admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.918419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb70ed-4841-4127-b344-db2cb2fa914f admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.918696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb70ed-4841-4127-b344-db2cb2fa914f admin admin] PATH_INFO: `/v3/projects/86547f7fd67444e0a898a7e7d2dc5ca2/users/985c6b0e329c4de58ddd206e42e9062b/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.921787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb70ed-4841-4127-b344-db2cb2fa914f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86547f7fd67444e0a898a7e7d2dc5ca2, user_id=985c6b0e329c4de58ddd206e42e9062b, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.924523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb70ed-4841-4127-b344-db2cb2fa914f admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.971671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 890/1780] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:53 2022] DELETE /identity/v3/users/8088799006474cbbb6ddf6544ce0b43b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:53.973103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1380e3-8b91-4b58-9f58-f0ff9514bfb7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.973390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1380e3-8b91-4b58-9f58-f0ff9514bfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.973666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1380e3-8b91-4b58-9f58-f0ff9514bfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.977512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 891/1781] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:53 2022] PUT /identity/v3/projects/86547f7fd67444e0a898a7e7d2dc5ca2/users/985c6b0e329c4de58ddd206e42e9062b/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:53.978928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c4892-5d6d-4cf4-8592-34a53a1cb482 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.979110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c4892-5d6d-4cf4-8592-34a53a1cb482 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.979384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c4892-5d6d-4cf4-8592-34a53a1cb482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.001796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4a3c4892-5d6d-4cf4-8592-34a53a1cb482 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:54.004567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4a3c4892-5d6d-4cf4-8592-34a53a1cb482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.118520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5e1380e3-8b91-4b58-9f58-f0ff9514bfb7 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:54.120114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5e1380e3-8b91-4b58-9f58-f0ff9514bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.178266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 892/1782] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:54.180078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5857-1b91-4cfb-9cea-681f8c73a517 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.181145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5857-1b91-4cfb-9cea-681f8c73a517 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.181572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5857-1b91-4cfb-9cea-681f8c73a517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.247004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:54.282338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-0d3c5857-1b91-4cfb-9cea-681f8c73a517 None None] MFA Rules not processed for user `985c6b0e329c4de58ddd206e42e9062b`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:54.283866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0d3c5857-1b91-4cfb-9cea-681f8c73a517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.310494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 891/1783] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:54.311382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1380e3-8b91-4b58-9f58-f0ff9514bfb7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.323251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5e1380e3-8b91-4b58-9f58-f0ff9514bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.348158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1380e3-8b91-4b58-9f58-f0ff9514bfb7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.379957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.392872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.392872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.392872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] PATH_INFO: `/v3/projects/f66ea1149b67480bb5d344a4dd9a0c28` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.393254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:54.393357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66ea1149b67480bb5d344a4dd9a0c28)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.394018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.455441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66ea1149b67480bb5d344a4dd9a0c28', 'request_id': 'req-558e4cbb-76a0-442d-9f1a-3a68c837cb55'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:54.465618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66ea1149b67480bb5d344a4dd9a0c28', 'request_id': 'req-558e4cbb-76a0-442d-9f1a-3a68c837cb55'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:54.477098 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66ea1149b67480bb5d344a4dd9a0c28', 'request_id': 'req-558e4cbb-76a0-442d-9f1a-3a68c837cb55'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:54.493566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] The token cache is being invalidate because project f66ea1149b67480bb5d344a4dd9a0c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:54.494173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:54.495333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:54.499024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 893/1784] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:54.499905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5857-1b91-4cfb-9cea-681f8c73a517 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.504475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0d3c5857-1b91-4cfb-9cea-681f8c73a517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.518029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 892/1785] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:54 2022] DELETE /identity/v3/projects/f66ea1149b67480bb5d344a4dd9a0c28 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:54.519258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.521025 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.592614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5857-1b91-4cfb-9cea-681f8c73a517 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.610140 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e4cbb-76a0-442d-9f1a-3a68c837cb55 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.615740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03736ba8-b527-4e1a-bfb2-43530e2efbbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.616685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03736ba8-b527-4e1a-bfb2-43530e2efbbf service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.617178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03736ba8-b527-4e1a-bfb2-43530e2efbbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.617680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03736ba8-b527-4e1a-bfb2-43530e2efbbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.620545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-03736ba8-b527-4e1a-bfb2-43530e2efbbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.703651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03736ba8-b527-4e1a-bfb2-43530e2efbbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.705784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03736ba8-b527-4e1a-bfb2-43530e2efbbf service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.708992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f2220-ad83-4925-ad51-c6076387fe87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.709746 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f2220-ad83-4925-ad51-c6076387fe87 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.710502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f2220-ad83-4925-ad51-c6076387fe87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.710798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f2220-ad83-4925-ad51-c6076387fe87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.719155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 893/1786] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:54.719898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8c1f2220-ad83-4925-ad51-c6076387fe87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.720758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03736ba8-b527-4e1a-bfb2-43530e2efbbf service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.722447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-03736ba8-b527-4e1a-bfb2-43530e2efbbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.757079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:54.847911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03736ba8-b527-4e1a-bfb2-43530e2efbbf service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.856885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846cf66-9c9d-416c-aa42-cc7006034b83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.857811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846cf66-9c9d-416c-aa42-cc7006034b83 service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.858221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846cf66-9c9d-416c-aa42-cc7006034b83 service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.858819 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846cf66-9c9d-416c-aa42-cc7006034b83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.861146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0846cf66-9c9d-416c-aa42-cc7006034b83 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.938737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846cf66-9c9d-416c-aa42-cc7006034b83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.940943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846cf66-9c9d-416c-aa42-cc7006034b83 service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.951861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 894/1787] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:21:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:21:54.958557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f2220-ad83-4925-ad51-c6076387fe87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.975287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f2220-ad83-4925-ad51-c6076387fe87 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.976097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846cf66-9c9d-416c-aa42-cc7006034b83 service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.976097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0846cf66-9c9d-416c-aa42-cc7006034b83 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.990733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 894/1788] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:54.991627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f2220-ad83-4925-ad51-c6076387fe87 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:55.009602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f2220-ad83-4925-ad51-c6076387fe87 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:55.016219 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04e4f7-cb2f-4e76-a535-aa65ce4288b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:55.016877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04e4f7-cb2f-4e76-a535-aa65ce4288b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:55.019281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04e4f7-cb2f-4e76-a535-aa65ce4288b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:55.019553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04e4f7-cb2f-4e76-a535-aa65ce4288b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:55.021251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846cf66-9c9d-416c-aa42-cc7006034b83 service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:55.023906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1c04e4f7-cb2f-4e76-a535-aa65ce4288b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:55.033744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:55.036097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:55.036391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:55.037804 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] PATH_INFO: `/v3/users/0fb78a291cd943a6bd3ef3236b9683bf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:55.041626 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb78a291cd943a6bd3ef3236b9683bf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:55.044711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:55.104249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:55.199258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb78a291cd943a6bd3ef3236b9683bf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:55.215929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04e4f7-cb2f-4e76-a535-aa65ce4288b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:55.217725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb78a291cd943a6bd3ef3236b9683bf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:55.218677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb78a291cd943a6bd3ef3236b9683bf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:55.219546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb78a291cd943a6bd3ef3236b9683bf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:55.224935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04e4f7-cb2f-4e76-a535-aa65ce4288b7 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:55.242643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-81dee9a3-052d-4d83-90e7-d898e7ddbf5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb78a291cd943a6bd3ef3236b9683bf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:55.259863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 895/1789] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:55.312913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 895/1790] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:21:54 2022] DELETE /identity/v3/users/0fb78a291cd943a6bd3ef3236b9683bf => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:56.909151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04e4f7-cb2f-4e76-a535-aa65ce4288b7 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:56.911571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1c04e4f7-cb2f-4e76-a535-aa65ce4288b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:56.985858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04e4f7-cb2f-4e76-a535-aa65ce4288b7 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:57.082514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:57.083820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:57.084361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:57.084887 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] PATH_INFO: `/v3/projects/e0cd17d3bbc542cf8e010de1156b647a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:57.086740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0cd17d3bbc542cf8e010de1156b647a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:57.089168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:57.175524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0cd17d3bbc542cf8e010de1156b647a', 'request_id': 'req-14527763-bd72-468a-b5fa-a9a166a559f2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:57.185579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0cd17d3bbc542cf8e010de1156b647a', 'request_id': 'req-14527763-bd72-468a-b5fa-a9a166a559f2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:57.198111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0cd17d3bbc542cf8e010de1156b647a', 'request_id': 'req-14527763-bd72-468a-b5fa-a9a166a559f2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:57.235309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] The token cache is being invalidate because project e0cd17d3bbc542cf8e010de1156b647a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:57.236017 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:57.237344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-14527763-bd72-468a-b5fa-a9a166a559f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:57.261446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 896/1791] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:56 2022] DELETE /identity/v3/projects/e0cd17d3bbc542cf8e010de1156b647a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:57.267306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480073-e486-4e4f-bbcd-acc229389d9e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:57.268941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480073-e486-4e4f-bbcd-acc229389d9e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:57.269490 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480073-e486-4e4f-bbcd-acc229389d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:57.339186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f8480073-e486-4e4f-bbcd-acc229389d9e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:57.340993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f8480073-e486-4e4f-bbcd-acc229389d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:57.362780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:57.475843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db253-cce8-409b-b0f0-1fe0563d0cb0 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:57.476133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db253-cce8-409b-b0f0-1fe0563d0cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:57.476411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db253-cce8-409b-b0f0-1fe0563d0cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:57.504938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 896/1792] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:57.510260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582527-3abf-4745-95bc-5e52cdf801aa None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:57.511982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582527-3abf-4745-95bc-5e52cdf801aa None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:57.512477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582527-3abf-4745-95bc-5e52cdf801aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:57.541470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-f47db253-cce8-409b-b0f0-1fe0563d0cb0 None None] MFA Rules not processed for user `13063cbf860c4ca98666500c3c125933`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:57.542900 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f47db253-cce8-409b-b0f0-1fe0563d0cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:57.555143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d6582527-3abf-4745-95bc-5e52cdf801aa None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:57.556815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d6582527-3abf-4745-95bc-5e52cdf801aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:57.577229 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 897/1793] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:57.581143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6582527-3abf-4745-95bc-5e52cdf801aa None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:57.609467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6582527-3abf-4745-95bc-5e52cdf801aa None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:57.626933 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c9dab-bb94-471c-ba0b-321db201f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:57.628335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c9dab-bb94-471c-ba0b-321db201f5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:57.628899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c9dab-bb94-471c-ba0b-321db201f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:57.631104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c9dab-bb94-471c-ba0b-321db201f5fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:57.633801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c9dab-bb94-471c-ba0b-321db201f5fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:57.635094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c9dab-bb94-471c-ba0b-321db201f5fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:57.661677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c9dab-bb94-471c-ba0b-321db201f5fb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:57.782250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 898/1794] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:57.797171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c9dab-bb94-471c-ba0b-321db201f5fb admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:57.833650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c9dab-bb94-471c-ba0b-321db201f5fb admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:57.873398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70273-ca13-4374-bfbb-e6be4a63343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:57.875660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70273-ca13-4374-bfbb-e6be4a63343d admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:57.875953 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70273-ca13-4374-bfbb-e6be4a63343d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:57.878204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70273-ca13-4374-bfbb-e6be4a63343d admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:57.879978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae70273-ca13-4374-bfbb-e6be4a63343d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:57.889811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae70273-ca13-4374-bfbb-e6be4a63343d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:57.900462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 897/1795] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Aug 9 12:21:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:21:57.997883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db253-cce8-409b-b0f0-1fe0563d0cb0 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:57.999335 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f47db253-cce8-409b-b0f0-1fe0563d0cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:58.002312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 899/1796] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:57 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:58.003654 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70273-ca13-4374-bfbb-e6be4a63343d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:58.026630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db253-cce8-409b-b0f0-1fe0563d0cb0 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:58.041006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:58.162305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e1497-7ff2-4325-9a68-dc50f4be449a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:58.163467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e1497-7ff2-4325-9a68-dc50f4be449a service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:58.163920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e1497-7ff2-4325-9a68-dc50f4be449a service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:58.164197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e1497-7ff2-4325-9a68-dc50f4be449a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:58.204033 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e1497-7ff2-4325-9a68-dc50f4be449a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:58.210935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e1497-7ff2-4325-9a68-dc50f4be449a service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:58.252738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70273-ca13-4374-bfbb-e6be4a63343d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:58.255604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 898/1797] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:58.256655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e1497-7ff2-4325-9a68-dc50f4be449a service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:58.260826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-936e1497-7ff2-4325-9a68-dc50f4be449a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:58.279921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3609931-3aa3-41e3-83d2-6da6cb291b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:58.280991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3609931-3aa3-41e3-83d2-6da6cb291b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:58.280991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3609931-3aa3-41e3-83d2-6da6cb291b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:58.281189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3609931-3aa3-41e3-83d2-6da6cb291b0a admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:58.282088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3609931-3aa3-41e3-83d2-6da6cb291b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:58.287509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3609931-3aa3-41e3-83d2-6da6cb291b0a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:58.289243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e1497-7ff2-4325-9a68-dc50f4be449a service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:58.298169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dbacc-24bd-40d3-a336-3f8d76e14b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:58.303136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dbacc-24bd-40d3-a336-3f8d76e14b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:58.305729 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dbacc-24bd-40d3-a336-3f8d76e14b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:58.306617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dbacc-24bd-40d3-a336-3f8d76e14b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:58.331523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dbacc-24bd-40d3-a336-3f8d76e14b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:58.334314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dbacc-24bd-40d3-a336-3f8d76e14b46 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:58.346308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 900/1798] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:58 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:58.347411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3609931-3aa3-41e3-83d2-6da6cb291b0a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:58.349547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c3609931-3aa3-41e3-83d2-6da6cb291b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:58.355249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 899/1799] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:58.356322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dbacc-24bd-40d3-a336-3f8d76e14b46 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:58.369077 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3609931-3aa3-41e3-83d2-6da6cb291b0a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:58.397377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b130716-5015-4645-909c-29197b824312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:58.398782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130716-5015-4645-909c-29197b824312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:58.399816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130716-5015-4645-909c-29197b824312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:58.400190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130716-5015-4645-909c-29197b824312 admin admin] PATH_INFO: `/v3/projects/f6a6e47d62fe46ce892dbb99365057bb` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:58.400461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dbacc-24bd-40d3-a336-3f8d76e14b46 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:58.403533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b130716-5015-4645-909c-29197b824312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a6e47d62fe46ce892dbb99365057bb)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:58.407467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b130716-5015-4645-909c-29197b824312 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:58.413538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba6c19-4204-44c7-8f88-975314c7e510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:58.413762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba6c19-4204-44c7-8f88-975314c7e510 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:58.414091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba6c19-4204-44c7-8f88-975314c7e510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:58.414457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba6c19-4204-44c7-8f88-975314c7e510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:58.415211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba6c19-4204-44c7-8f88-975314c7e510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:58.417082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba6c19-4204-44c7-8f88-975314c7e510 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:58.444598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 900/1800] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:58.445716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba6c19-4204-44c7-8f88-975314c7e510 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:58.471843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba6c19-4204-44c7-8f88-975314c7e510 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:58.497267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec07cba-f3d0-4e16-9869-74e0be8b9423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:58.499140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec07cba-f3d0-4e16-9869-74e0be8b9423 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:58.501059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec07cba-f3d0-4e16-9869-74e0be8b9423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:58.501696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec07cba-f3d0-4e16-9869-74e0be8b9423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:58.505524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec07cba-f3d0-4e16-9869-74e0be8b9423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:58.512392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec07cba-f3d0-4e16-9869-74e0be8b9423 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:58.545058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0b130716-5015-4645-909c-29197b824312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a6e47d62fe46ce892dbb99365057bb', 'request_id': 'req-0b130716-5015-4645-909c-29197b824312'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:58.560110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 901/1801] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:58.563609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec07cba-f3d0-4e16-9869-74e0be8b9423 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:58.566865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:58.569998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0b130716-5015-4645-909c-29197b824312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a6e47d62fe46ce892dbb99365057bb', 'request_id': 'req-0b130716-5015-4645-909c-29197b824312'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:58.585712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0b130716-5015-4645-909c-29197b824312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a6e47d62fe46ce892dbb99365057bb', 'request_id': 'req-0b130716-5015-4645-909c-29197b824312'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:58.596669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec07cba-f3d0-4e16-9869-74e0be8b9423 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:58.617442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0b130716-5015-4645-909c-29197b824312 admin admin] The token cache is being invalidate because project f6a6e47d62fe46ce892dbb99365057bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:58.618090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0b130716-5015-4645-909c-29197b824312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:58.619499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-0b130716-5015-4645-909c-29197b824312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:58.622060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 901/1802] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:58 2022] DELETE /identity/v3/projects/f6a6e47d62fe46ce892dbb99365057bb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:58.627692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2ca7d-98f5-4d63-8c1b-5f2e2f867f8b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:58.628689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2ca7d-98f5-4d63-8c1b-5f2e2f867f8b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:58.630110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2ca7d-98f5-4d63-8c1b-5f2e2f867f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:58.689884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ebf2ca7d-98f5-4d63-8c1b-5f2e2f867f8b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:58.689884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ebf2ca7d-98f5-4d63-8c1b-5f2e2f867f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:58.759039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349ed10-0d90-49f7-b0f7-01bda8e45c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:58.759244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349ed10-0d90-49f7-b0f7-01bda8e45c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:58.759464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349ed10-0d90-49f7-b0f7-01bda8e45c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:58.762072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349ed10-0d90-49f7-b0f7-01bda8e45c59 admin admin] PATH_INFO: `/v3/projects/f43a16da8cb843b5a9af27a06ec0a2be/users/ccc4febb85214a999e3e99b66e97f1ff/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:58.785183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349ed10-0d90-49f7-b0f7-01bda8e45c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43a16da8cb843b5a9af27a06ec0a2be, user_id=ccc4febb85214a999e3e99b66e97f1ff, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:58.789304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349ed10-0d90-49f7-b0f7-01bda8e45c59 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:58.815986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 902/1803] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:58 2022] PUT /identity/v3/projects/f43a16da8cb843b5a9af27a06ec0a2be/users/ccc4febb85214a999e3e99b66e97f1ff/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:58.835368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed15f-c637-402b-b319-72e607559479 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:58.835368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed15f-c637-402b-b319-72e607559479 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:58.835855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed15f-c637-402b-b319-72e607559479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:58.854458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 902/1804] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:58.862268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e4f4d-94d5-44d6-8874-5220831a3977 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:58.862708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e4f4d-94d5-44d6-8874-5220831a3977 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:58.863080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e4f4d-94d5-44d6-8874-5220831a3977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:58.905840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b72e4f4d-94d5-44d6-8874-5220831a3977 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:58.907235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b72e4f4d-94d5-44d6-8874-5220831a3977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:58.910766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-f18ed15f-c637-402b-b319-72e607559479 None None] MFA Rules not processed for user `ccc4febb85214a999e3e99b66e97f1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:58.912156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f18ed15f-c637-402b-b319-72e607559479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:59.033130 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:59.046762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 903/1805] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:21:59.052047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e4f4d-94d5-44d6-8874-5220831a3977 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:59.094067 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 903/1806] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:21:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:59.094259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e4f4d-94d5-44d6-8874-5220831a3977 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:59.110387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed15f-c637-402b-b319-72e607559479 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:59.122873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab4a8-22ac-4741-bd0d-8987a6a5493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:59.123610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab4a8-22ac-4741-bd0d-8987a6a5493e admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:59.124300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f18ed15f-c637-402b-b319-72e607559479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:59.125276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab4a8-22ac-4741-bd0d-8987a6a5493e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:59.125660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab4a8-22ac-4741-bd0d-8987a6a5493e admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:59.126586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ab4a8-22ac-4741-bd0d-8987a6a5493e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:59.126985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ab4a8-22ac-4741-bd0d-8987a6a5493e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:59.131791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ab4a8-22ac-4741-bd0d-8987a6a5493e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:59.196857 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 904/1807] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:59.204470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab4a8-22ac-4741-bd0d-8987a6a5493e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:59.208761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed15f-c637-402b-b319-72e607559479 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:59.238022 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118206de-0914-4ddb-ab51-a098431615a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:59.238248 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab4a8-22ac-4741-bd0d-8987a6a5493e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:59.238656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118206de-0914-4ddb-ab51-a098431615a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:59.238932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118206de-0914-4ddb-ab51-a098431615a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:59.242885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118206de-0914-4ddb-ab51-a098431615a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:59.245932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118206de-0914-4ddb-ab51-a098431615a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:59.247763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118206de-0914-4ddb-ab51-a098431615a2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:59.252438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c0879-6d19-47ef-bc91-88761317c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:59.253781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c0879-6d19-47ef-bc91-88761317c692 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:59.254069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c0879-6d19-47ef-bc91-88761317c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:59.254379 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c0879-6d19-47ef-bc91-88761317c692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:59.259106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c0879-6d19-47ef-bc91-88761317c692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:59.265159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c0879-6d19-47ef-bc91-88761317c692 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:59.331266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 904/1808] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:59 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:59.332368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118206de-0914-4ddb-ab51-a098431615a2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:59.370328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 905/1809] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:59 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:59.384669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c0879-6d19-47ef-bc91-88761317c692 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:59.384669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9a2c0879-6d19-47ef-bc91-88761317c692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:59.510124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118206de-0914-4ddb-ab51-a098431615a2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:59.532959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:59.584878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c0879-6d19-47ef-bc91-88761317c692 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:59.602144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:59.609446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:59.609446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:59.609446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] PATH_INFO: `/v3/projects/34f24346b173408a928ed30a49f38a96` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:59.611457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f24346b173408a928ed30a49f38a96)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:59.613467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:59.694081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd50bd-e887-41a3-bcb6-8d8faf731c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:59.694705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd50bd-e887-41a3-bcb6-8d8faf731c76 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:59.694987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd50bd-e887-41a3-bcb6-8d8faf731c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:59.703400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd50bd-e887-41a3-bcb6-8d8faf731c76 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:59.703400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd50bd-e887-41a3-bcb6-8d8faf731c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:59.705803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd50bd-e887-41a3-bcb6-8d8faf731c76 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:59.736706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f24346b173408a928ed30a49f38a96', 'request_id': 'req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:59.756697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f24346b173408a928ed30a49f38a96', 'request_id': 'req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:59.778043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 905/1810] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:59 2022] POST /identity/v3/users => generated 295 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:59.780446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd50bd-e887-41a3-bcb6-8d8faf731c76 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:59.803896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f24346b173408a928ed30a49f38a96', 'request_id': 'req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:59.843218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] The token cache is being invalidate because project 34f24346b173408a928ed30a49f38a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:21:59.843218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:59.843218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:21:59.844639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 906/1811] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:21:59 2022] DELETE /identity/v3/projects/34f24346b173408a928ed30a49f38a96 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:59.846980 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd50bd-e887-41a3-bcb6-8d8faf731c76 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:59.852683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:59.854458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:00.059759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b3e8b-6f9f-4296-a4ae-3800bbcb5906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:00.063881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b3e8b-6f9f-4296-a4ae-3800bbcb5906 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:00.066509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b3e8b-6f9f-4296-a4ae-3800bbcb5906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:00.066951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b3e8b-6f9f-4296-a4ae-3800bbcb5906 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:00.069271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b3e8b-6f9f-4296-a4ae-3800bbcb5906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:00.074550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b3e8b-6f9f-4296-a4ae-3800bbcb5906 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:00.114519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:00.162181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 906/1812] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:59 2022] POST /identity/v3/users => generated 290 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:00.168503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b3e8b-6f9f-4296-a4ae-3800bbcb5906 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:00.178882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5b5b3e8b-6f9f-4296-a4ae-3800bbcb5906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:00.225002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6e8b5-180d-4fb2-b6f5-8b45a5d48865 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:00.238821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b3e8b-6f9f-4296-a4ae-3800bbcb5906 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:00.244086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b039f7-ace2-4971-b7f8-9cb9ba3cc905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:00.244827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b039f7-ace2-4971-b7f8-9cb9ba3cc905 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:00.245109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b039f7-ace2-4971-b7f8-9cb9ba3cc905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:00.245381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b039f7-ace2-4971-b7f8-9cb9ba3cc905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:00.251530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b039f7-ace2-4971-b7f8-9cb9ba3cc905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:00.260403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b039f7-ace2-4971-b7f8-9cb9ba3cc905 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:00.267510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:00.270455 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:00.270792 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:00.271050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] PATH_INFO: `/v3/users/8baeafb4cca6472795e87d0507de27a3` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:00.281786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8baeafb4cca6472795e87d0507de27a3)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:00.295035 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:00.333695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 907/1813] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:00.333695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b039f7-ace2-4971-b7f8-9cb9ba3cc905 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:00.343460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-41b039f7-ace2-4971-b7f8-9cb9ba3cc905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:00.413023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b039f7-ace2-4971-b7f8-9cb9ba3cc905 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:00.442076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212093a1-8edc-4060-b2cb-14fd00227d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:00.444836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212093a1-8edc-4060-b2cb-14fd00227d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:00.447561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212093a1-8edc-4060-b2cb-14fd00227d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:00.448237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212093a1-8edc-4060-b2cb-14fd00227d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:00.450010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212093a1-8edc-4060-b2cb-14fd00227d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:00.459083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212093a1-8edc-4060-b2cb-14fd00227d25 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:00.507245 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 908/1814] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:00.507245 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212093a1-8edc-4060-b2cb-14fd00227d25 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:00.507875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8baeafb4cca6472795e87d0507de27a3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:00.524912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8baeafb4cca6472795e87d0507de27a3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:00.525821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8baeafb4cca6472795e87d0507de27a3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:00.526952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8baeafb4cca6472795e87d0507de27a3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:00.559560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212093a1-8edc-4060-b2cb-14fd00227d25 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:00.566380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8baeafb4cca6472795e87d0507de27a3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:00.576041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24278-bfb4-4489-b69c-e16539a528c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:00.578081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24278-bfb4-4489-b69c-e16539a528c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:00.580008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24278-bfb4-4489-b69c-e16539a528c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:00.582408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24278-bfb4-4489-b69c-e16539a528c5 admin admin] PATH_INFO: `/v3/projects/bdd197e4d325466f863add3f575c2082/users/c9255beace23422bb5d823e930876ea0/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:00.632127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 907/1815] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:00 2022] DELETE /identity/v3/users/8baeafb4cca6472795e87d0507de27a3 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:00.633055 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:00.638717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:00.641893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24278-bfb4-4489-b69c-e16539a528c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd197e4d325466f863add3f575c2082, user_id=c9255beace23422bb5d823e930876ea0, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:00.670978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24278-bfb4-4489-b69c-e16539a528c5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:00.704662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 909/1816] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:00 2022] PUT /identity/v3/projects/bdd197e4d325466f863add3f575c2082/users/c9255beace23422bb5d823e930876ea0/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:00.709220 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24278-bfb4-4489-b69c-e16539a528c5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:00.712247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fbd24278-bfb4-4489-b69c-e16539a528c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:00.861437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:00.914916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1a650-40b6-4b60-8763-b78a6f34bbfd admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:00.935639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24278-bfb4-4489-b69c-e16539a528c5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:00.938984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43ad4c-3121-4267-9670-392d160509a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:00.939865 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43ad4c-3121-4267-9670-392d160509a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:00.940337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43ad4c-3121-4267-9670-392d160509a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:00.940810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43ad4c-3121-4267-9670-392d160509a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:00.941620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43ad4c-3121-4267-9670-392d160509a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:00.945610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43ad4c-3121-4267-9670-392d160509a3 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:00.952414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd838ab2-91e7-4360-a3e2-18bd3c0983ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:00.956727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd838ab2-91e7-4360-a3e2-18bd3c0983ec admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:00.958531 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd838ab2-91e7-4360-a3e2-18bd3c0983ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:00.958822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd838ab2-91e7-4360-a3e2-18bd3c0983ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:00.960744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd838ab2-91e7-4360-a3e2-18bd3c0983ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:00.969176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd838ab2-91e7-4360-a3e2-18bd3c0983ec admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:00.985217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 908/1817] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:00.990409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43ad4c-3121-4267-9670-392d160509a3 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:01.010078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43ad4c-3121-4267-9670-392d160509a3 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:01.036895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc811b-2567-4be8-a7ad-b3b2e9be762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:01.037596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc811b-2567-4be8-a7ad-b3b2e9be762c admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:01.038398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc811b-2567-4be8-a7ad-b3b2e9be762c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:01.038398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc811b-2567-4be8-a7ad-b3b2e9be762c admin admin] PATH_INFO: `/v3/projects/7ee66e63647d4e5ca3cbdd7f799815fc/users/a13bc9724f0447e299a952ef4328c6a8/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:01.049687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 910/1818] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:01.052826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd838ab2-91e7-4360-a3e2-18bd3c0983ec admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:01.078757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc811b-2567-4be8-a7ad-b3b2e9be762c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee66e63647d4e5ca3cbdd7f799815fc, user_id=a13bc9724f0447e299a952ef4328c6a8, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:01.082205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc811b-2567-4be8-a7ad-b3b2e9be762c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:01.092863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd838ab2-91e7-4360-a3e2-18bd3c0983ec admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:01.114181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b08827-e7d0-4678-a1fa-87492349470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:01.115409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08827-e7d0-4678-a1fa-87492349470e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:01.119008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08827-e7d0-4678-a1fa-87492349470e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:01.119300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08827-e7d0-4678-a1fa-87492349470e admin admin] PATH_INFO: `/v3/projects/bdd197e4d325466f863add3f575c2082/users/c9255beace23422bb5d823e930876ea0/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:01.124665 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 909/1819] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:00 2022] PUT /identity/v3/projects/7ee66e63647d4e5ca3cbdd7f799815fc/users/a13bc9724f0447e299a952ef4328c6a8/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:01.130000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b08827-e7d0-4678-a1fa-87492349470e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd197e4d325466f863add3f575c2082, user_id=c9255beace23422bb5d823e930876ea0, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:01.144421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ec1d3-6ec5-4d00-94c1-8a063cd02a86 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:01.144421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ec1d3-6ec5-4d00-94c1-8a063cd02a86 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:01.144725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b08827-e7d0-4678-a1fa-87492349470e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:01.144811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ec1d3-6ec5-4d00-94c1-8a063cd02a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:01.188731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 911/1820] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:01 2022] PUT /identity/v3/projects/bdd197e4d325466f863add3f575c2082/users/c9255beace23422bb5d823e930876ea0/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:01.210737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53b4f7-a1ff-4728-ae8f-b2e387b8605b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:01.210737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53b4f7-a1ff-4728-ae8f-b2e387b8605b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:01.210737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53b4f7-a1ff-4728-ae8f-b2e387b8605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:01.286133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2b53b4f7-a1ff-4728-ae8f-b2e387b8605b None None] MFA Rules not processed for user `c9255beace23422bb5d823e930876ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:01.288067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2b53b4f7-a1ff-4728-ae8f-b2e387b8605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:01.321930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-6c6ec1d3-6ec5-4d00-94c1-8a063cd02a86 None None] MFA Rules not processed for user `a13bc9724f0447e299a952ef4328c6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:01.324101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-6c6ec1d3-6ec5-4d00-94c1-8a063cd02a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:01.442666 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:01.565252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 910/1821] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:01.566964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99f001-1e00-4329-a34d-a1ad4406e0e5 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:01.567402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99f001-1e00-4329-a34d-a1ad4406e0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:01.567990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99f001-1e00-4329-a34d-a1ad4406e0e5 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:01.570196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 911/1822] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:01.572999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99f001-1e00-4329-a34d-a1ad4406e0e5 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:01.594898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 912/1823] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:01.609665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53b4f7-a1ff-4728-ae8f-b2e387b8605b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:01.611327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2b53b4f7-a1ff-4728-ae8f-b2e387b8605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:01.684616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99f001-1e00-4329-a34d-a1ad4406e0e5 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:01.701983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a908e13-185a-42fb-8507-75bb6c3ebb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:01.702882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908e13-185a-42fb-8507-75bb6c3ebb62 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:01.703387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908e13-185a-42fb-8507-75bb6c3ebb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:01.703871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908e13-185a-42fb-8507-75bb6c3ebb62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:01.704822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a908e13-185a-42fb-8507-75bb6c3ebb62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:01.707898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a908e13-185a-42fb-8507-75bb6c3ebb62 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:01.770954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 912/1824] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:01 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:01.778013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a908e13-185a-42fb-8507-75bb6c3ebb62 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:01.817052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53b4f7-a1ff-4728-ae8f-b2e387b8605b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:01.958401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b58ec-fb60-49e3-97c9-0b40e935c7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:01.959631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b58ec-fb60-49e3-97c9-0b40e935c7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:01.960075 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b58ec-fb60-49e3-97c9-0b40e935c7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:01.960497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b58ec-fb60-49e3-97c9-0b40e935c7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:01.965149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ca5b58ec-fb60-49e3-97c9-0b40e935c7c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:01.965940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a908e13-185a-42fb-8507-75bb6c3ebb62 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:01.981347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67eb1b-c2c1-49dd-9bd8-5cea23343bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:01.982245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67eb1b-c2c1-49dd-9bd8-5cea23343bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:01.982947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67eb1b-c2c1-49dd-9bd8-5cea23343bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:01.983400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67eb1b-c2c1-49dd-9bd8-5cea23343bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:01.984257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67eb1b-c2c1-49dd-9bd8-5cea23343bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:01.989021 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67eb1b-c2c1-49dd-9bd8-5cea23343bd8 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:02.017042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:02.064246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 913/1825] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:01 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:02.068425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f46d5-c6e4-41c2-ae7b-dff478381b8b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:02.068425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f46d5-c6e4-41c2-ae7b-dff478381b8b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:02.068425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f46d5-c6e4-41c2-ae7b-dff478381b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:02.121788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b58ec-fb60-49e3-97c9-0b40e935c7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:02.124957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b58ec-fb60-49e3-97c9-0b40e935c7c0 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:02.147300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-252f46d5-c6e4-41c2-ae7b-dff478381b8b None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:02.155107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-252f46d5-c6e4-41c2-ae7b-dff478381b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:02.165800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 913/1826] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:02.170942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b58ec-fb60-49e3-97c9-0b40e935c7c0 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:02.208899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b58ec-fb60-49e3-97c9-0b40e935c7c0 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:02.235750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe16a5-1a02-4065-8319-55704b3dc6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:02.237321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe16a5-1a02-4065-8319-55704b3dc6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:02.248381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe16a5-1a02-4065-8319-55704b3dc6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:02.248381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe16a5-1a02-4065-8319-55704b3dc6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:02.249277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe16a5-1a02-4065-8319-55704b3dc6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:02.250771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe16a5-1a02-4065-8319-55704b3dc6aa admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:02.285058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 914/1827] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:02.287693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe16a5-1a02-4065-8319-55704b3dc6aa admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:02.309868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe16a5-1a02-4065-8319-55704b3dc6aa admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:02.318422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5dc3c-5be9-41a5-96e5-aef3e0005140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:02.319485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5dc3c-5be9-41a5-96e5-aef3e0005140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:02.319913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5dc3c-5be9-41a5-96e5-aef3e0005140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:02.320371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5dc3c-5be9-41a5-96e5-aef3e0005140 admin admin] PATH_INFO: `/v3/projects/d66c173139bd42808894c127d94f3c73/users/935df3d211ec4840b40e3782e9f0cf3e/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:02.331821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:02.363942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5dc3c-5be9-41a5-96e5-aef3e0005140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66c173139bd42808894c127d94f3c73, user_id=935df3d211ec4840b40e3782e9f0cf3e, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:02.373400 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5dc3c-5be9-41a5-96e5-aef3e0005140 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:02.424583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 915/1828] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:02 2022] PUT /identity/v3/projects/d66c173139bd42808894c127d94f3c73/users/935df3d211ec4840b40e3782e9f0cf3e/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:02.427830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5dc3c-5be9-41a5-96e5-aef3e0005140 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:02.482924 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 914/1829] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:02.641453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5dc3c-5be9-41a5-96e5-aef3e0005140 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:02.647254 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915fe31-60d6-4762-920f-a91fbcf987db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:02.647874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915fe31-60d6-4762-920f-a91fbcf987db admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:02.648148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915fe31-60d6-4762-920f-a91fbcf987db admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:02.648417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915fe31-60d6-4762-920f-a91fbcf987db admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:02.649141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915fe31-60d6-4762-920f-a91fbcf987db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:02.650734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915fe31-60d6-4762-920f-a91fbcf987db admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:02.687342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 916/1830] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:02.693386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f46d5-c6e4-41c2-ae7b-dff478381b8b None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:02.718065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f46d5-c6e4-41c2-ae7b-dff478381b8b None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:02.734398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2bc6d-48e7-4681-ae85-8896b7df83dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:02.737350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2bc6d-48e7-4681-ae85-8896b7df83dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:02.737680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2bc6d-48e7-4681-ae85-8896b7df83dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:02.738382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2bc6d-48e7-4681-ae85-8896b7df83dd admin admin] PATH_INFO: `/v3/projects/d66c173139bd42808894c127d94f3c73/users/935df3d211ec4840b40e3782e9f0cf3e/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:02.744170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2bc6d-48e7-4681-ae85-8896b7df83dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66c173139bd42808894c127d94f3c73, user_id=935df3d211ec4840b40e3782e9f0cf3e, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:02.757824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2bc6d-48e7-4681-ae85-8896b7df83dd admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:02.830642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 915/1831] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:02 2022] PUT /identity/v3/projects/d66c173139bd42808894c127d94f3c73/users/935df3d211ec4840b40e3782e9f0cf3e/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:02.831701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd930a6-a7ab-4957-b11e-bae7640d5bc9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:02.832186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd930a6-a7ab-4957-b11e-bae7640d5bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:02.832678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd930a6-a7ab-4957-b11e-bae7640d5bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:02.899250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0cd930a6-a7ab-4957-b11e-bae7640d5bc9 None None] MFA Rules not processed for user `935df3d211ec4840b40e3782e9f0cf3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:02.900571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0cd930a6-a7ab-4957-b11e-bae7640d5bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:03.051756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 917/1832] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:03.066600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2bc6d-48e7-4681-ae85-8896b7df83dd admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:03.071636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-71a2bc6d-48e7-4681-ae85-8896b7df83dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:03.142275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd930a6-a7ab-4957-b11e-bae7640d5bc9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:03.143679 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0cd930a6-a7ab-4957-b11e-bae7640d5bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:03.173929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:03.274997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2bc6d-48e7-4681-ae85-8896b7df83dd admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:03.284776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fb6c0-d27d-49a5-bbc2-45b1da27352d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:03.287393 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fb6c0-d27d-49a5-bbc2-45b1da27352d service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:03.287691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fb6c0-d27d-49a5-bbc2-45b1da27352d service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:03.288943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fb6c0-d27d-49a5-bbc2-45b1da27352d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:03.318097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fb6c0-d27d-49a5-bbc2-45b1da27352d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:03.321524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fb6c0-d27d-49a5-bbc2-45b1da27352d service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:03.364391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 916/1833] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:03.367170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fb6c0-d27d-49a5-bbc2-45b1da27352d service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:03.373339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-363fb6c0-d27d-49a5-bbc2-45b1da27352d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:03.418382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd930a6-a7ab-4957-b11e-bae7640d5bc9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:03.430715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:03.435707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:03.436188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:03.436492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] PATH_INFO: `/v3/projects/bcad661386fe4397a0b67f73ac30120b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:03.437834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcad661386fe4397a0b67f73ac30120b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:03.440088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:03.561000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcad661386fe4397a0b67f73ac30120b', 'request_id': 'req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:03.577222 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcad661386fe4397a0b67f73ac30120b', 'request_id': 'req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:03.590143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcad661386fe4397a0b67f73ac30120b', 'request_id': 'req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:03.611873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] The token cache is being invalidate because project bcad661386fe4397a0b67f73ac30120b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:03.612175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:03.613789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8c7138a-a10e-4c51-bf00-c2b3b85c7bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:03.623009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 918/1834] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:03 2022] DELETE /identity/v3/projects/bcad661386fe4397a0b67f73ac30120b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:03.624934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c533a0f-7a77-4522-bee0-bd50e9e526fc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:03.625280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c533a0f-7a77-4522-bee0-bd50e9e526fc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:03.625555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c533a0f-7a77-4522-bee0-bd50e9e526fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:03.680252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fb6c0-d27d-49a5-bbc2-45b1da27352d service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:03.682251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9c533a0f-7a77-4522-bee0-bd50e9e526fc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:03.692674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9c533a0f-7a77-4522-bee0-bd50e9e526fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:03.940025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:03.962939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 919/1835] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:03.965113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c533a0f-7a77-4522-bee0-bd50e9e526fc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:03.989039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9c533a0f-7a77-4522-bee0-bd50e9e526fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:03.993788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfaa7f-4a67-41af-a3ef-d275a3e54f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:03.995598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfaa7f-4a67-41af-a3ef-d275a3e54f26 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:03.996289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfaa7f-4a67-41af-a3ef-d275a3e54f26 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:03.997876 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfaa7f-4a67-41af-a3ef-d275a3e54f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.003765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c1bfaa7f-4a67-41af-a3ef-d275a3e54f26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:04.015843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c533a0f-7a77-4522-bee0-bd50e9e526fc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:04.034320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:04.035222 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.035725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.036086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] PATH_INFO: `/v3/users/23fbc37f644f44f5b51cbc1aad82cc3b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.038751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23fbc37f644f44f5b51cbc1aad82cc3b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:04.043300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfaa7f-4a67-41af-a3ef-d275a3e54f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:04.044030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:04.045996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfaa7f-4a67-41af-a3ef-d275a3e54f26 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:04.060511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 917/1836] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:04.088239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0201f4-b6a3-47c9-9487-ee011dc6a305 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.088936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0201f4-b6a3-47c9-9487-ee011dc6a305 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.090792 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0201f4-b6a3-47c9-9487-ee011dc6a305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.174019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-0c0201f4-b6a3-47c9-9487-ee011dc6a305 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:04.175591 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0c0201f4-b6a3-47c9-9487-ee011dc6a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:04.188049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 918/1837] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:04.192437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0201f4-b6a3-47c9-9487-ee011dc6a305 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:04.236072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0201f4-b6a3-47c9-9487-ee011dc6a305 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:04.252857 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:04.268186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c696-cffe-4692-a483-bfaeed4d7850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:04.269071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c696-cffe-4692-a483-bfaeed4d7850 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.269506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c696-cffe-4692-a483-bfaeed4d7850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.269869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c696-cffe-4692-a483-bfaeed4d7850 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.270611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c696-cffe-4692-a483-bfaeed4d7850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:04.272484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c696-cffe-4692-a483-bfaeed4d7850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:04.274386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c696-cffe-4692-a483-bfaeed4d7850 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:04.324455 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 919/1838] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:04.329199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c696-cffe-4692-a483-bfaeed4d7850 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:04.332286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0166c696-cffe-4692-a483-bfaeed4d7850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:04.350771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23fbc37f644f44f5b51cbc1aad82cc3b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.360680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23fbc37f644f44f5b51cbc1aad82cc3b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.361388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23fbc37f644f44f5b51cbc1aad82cc3b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.362017 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23fbc37f644f44f5b51cbc1aad82cc3b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.373560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23fbc37f644f44f5b51cbc1aad82cc3b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.406733 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 920/1839] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:03 2022] DELETE /identity/v3/users/23fbc37f644f44f5b51cbc1aad82cc3b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:04.408486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:04.412462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:04.553846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c696-cffe-4692-a483-bfaeed4d7850 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:04.582933 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be174-97a5-4a13-9315-db37dd775d10 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:04.613614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17421581-daaf-4fe0-a40e-5f4336a2d072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:04.615649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17421581-daaf-4fe0-a40e-5f4336a2d072 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.615970 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17421581-daaf-4fe0-a40e-5f4336a2d072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.618144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17421581-daaf-4fe0-a40e-5f4336a2d072 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.618805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17421581-daaf-4fe0-a40e-5f4336a2d072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:04.629582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17421581-daaf-4fe0-a40e-5f4336a2d072 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:04.660333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46005f-987e-494f-9bc4-6970017ae82a tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935df3d211ec4840b40e3782e9f0cf3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd66c173139bd42808894c127d94f3c73', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:04.661280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46005f-987e-494f-9bc4-6970017ae82a tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.661451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46005f-987e-494f-9bc4-6970017ae82a tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.661636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46005f-987e-494f-9bc4-6970017ae82a tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.662701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46005f-987e-494f-9bc4-6970017ae82a tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:04.669591 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46005f-987e-494f-9bc4-6970017ae82a tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:04.671603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46005f-987e-494f-9bc4-6970017ae82a tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:04.686818 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 920/1840] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:04.688370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27ecfa-d1e6-4d04-998c-5f08e4c15028 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.688795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27ecfa-d1e6-4d04-998c-5f08e4c15028 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.689138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27ecfa-d1e6-4d04-998c-5f08e4c15028 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.691555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 921/1841] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:22:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:04.693309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5511c-e56b-4219-81c6-003b268299a0 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.693696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5511c-e56b-4219-81c6-003b268299a0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.694084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5511c-e56b-4219-81c6-003b268299a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.721324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a0d5511c-e56b-4219-81c6-003b268299a0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:04.722563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a0d5511c-e56b-4219-81c6-003b268299a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:04.725989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 921/1842] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:04 2022] POST /identity/v3/projects => generated 369 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:04.726684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17421581-daaf-4fe0-a40e-5f4336a2d072 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:04.733063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-17421581-daaf-4fe0-a40e-5f4336a2d072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:04.934285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 922/1843] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:04.938614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5511c-e56b-4219-81c6-003b268299a0 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:04.966375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5511c-e56b-4219-81c6-003b268299a0 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:04.967839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17421581-daaf-4fe0-a40e-5f4336a2d072 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:04.977279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76237b22-6d1d-4bec-9f2b-b9a3de75d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:04.982089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237b22-6d1d-4bec-9f2b-b9a3de75d2cd admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.982986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03cdcf-904a-4530-a4a6-645952028993 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935df3d211ec4840b40e3782e9f0cf3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd66c173139bd42808894c127d94f3c73', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:04.984046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03cdcf-904a-4530-a4a6-645952028993 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.984891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03cdcf-904a-4530-a4a6-645952028993 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.985363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03cdcf-904a-4530-a4a6-645952028993 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.986658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03cdcf-904a-4530-a4a6-645952028993 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:04.990429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237b22-6d1d-4bec-9f2b-b9a3de75d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.990966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237b22-6d1d-4bec-9f2b-b9a3de75d2cd admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.992041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76237b22-6d1d-4bec-9f2b-b9a3de75d2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:04.993959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03cdcf-904a-4530-a4a6-645952028993 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:05.009063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76237b22-6d1d-4bec-9f2b-b9a3de75d2cd admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:05.023760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:05.055158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 923/1844] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:04 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:05.055158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0990b1-c8c3-4d75-a0e1-40ea06cf5e7b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:05.055158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0990b1-c8c3-4d75-a0e1-40ea06cf5e7b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:05.055158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0990b1-c8c3-4d75-a0e1-40ea06cf5e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:05.089371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-2d0990b1-c8c3-4d75-a0e1-40ea06cf5e7b None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:05.091840 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2d0990b1-c8c3-4d75-a0e1-40ea06cf5e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:05.105192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 922/1845] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:04 2022] POST /identity/v3/projects => generated 354 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:05.142947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03cdcf-904a-4530-a4a6-645952028993 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:05.142947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6c03cdcf-904a-4530-a4a6-645952028993 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:05.235323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:05.351308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 924/1846] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:22:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:05.357245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0990b1-c8c3-4d75-a0e1-40ea06cf5e7b None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:05.364926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03cdcf-904a-4530-a4a6-645952028993 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:05.377604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564c718-7674-4644-b422-611165b5ce7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:05.378617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564c718-7674-4644-b422-611165b5ce7b service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:05.379114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564c718-7674-4644-b422-611165b5ce7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:05.379713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564c718-7674-4644-b422-611165b5ce7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:05.516740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0990b1-c8c3-4d75-a0e1-40ea06cf5e7b None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:05.521581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef680b6-6bd5-4fb0-b759-5a9acc7b9f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:05.522136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef680b6-6bd5-4fb0-b759-5a9acc7b9f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:05.522519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef680b6-6bd5-4fb0-b759-5a9acc7b9f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:05.522891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef680b6-6bd5-4fb0-b759-5a9acc7b9f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:05.523822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef680b6-6bd5-4fb0-b759-5a9acc7b9f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:05.527512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef680b6-6bd5-4fb0-b759-5a9acc7b9f18 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:05.551205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 925/1847] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:05.553129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef680b6-6bd5-4fb0-b759-5a9acc7b9f18 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:05.620058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564c718-7674-4644-b422-611165b5ce7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:05.622331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564c718-7674-4644-b422-611165b5ce7b service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:05.653266 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 923/1848] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:05.656894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564c718-7674-4644-b422-611165b5ce7b service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:05.720176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564c718-7674-4644-b422-611165b5ce7b service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:05.724040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef680b6-6bd5-4fb0-b759-5a9acc7b9f18 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:05.762539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b695f7-2a0d-4567-8d19-e67717d79f5c tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935df3d211ec4840b40e3782e9f0cf3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd66c173139bd42808894c127d94f3c73', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:05.765961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b695f7-2a0d-4567-8d19-e67717d79f5c tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:05.766776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b695f7-2a0d-4567-8d19-e67717d79f5c tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:05.767350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b695f7-2a0d-4567-8d19-e67717d79f5c tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:05.768192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b695f7-2a0d-4567-8d19-e67717d79f5c tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:05.768726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b695f7-2a0d-4567-8d19-e67717d79f5c tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:05.770585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b695f7-2a0d-4567-8d19-e67717d79f5c tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:05.774943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b1346-252b-4934-a546-be14b5077b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:05.776462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b1346-252b-4934-a546-be14b5077b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:05.778432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b1346-252b-4934-a546-be14b5077b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:05.780921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b1346-252b-4934-a546-be14b5077b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:05.782310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b1346-252b-4934-a546-be14b5077b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:05.794170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b1346-252b-4934-a546-be14b5077b2b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:05.812553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 926/1849] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:05.832076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b695f7-2a0d-4567-8d19-e67717d79f5c tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:05.838909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e1b695f7-2a0d-4567-8d19-e67717d79f5c tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:05.848936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 924/1850] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:05.854651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b1346-252b-4934-a546-be14b5077b2b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:05.862225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5c7b1346-252b-4934-a546-be14b5077b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:05.906101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b695f7-2a0d-4567-8d19-e67717d79f5c tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:05.924026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7f6fd-5ff4-4371-a0df-9b409297b2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:05.924804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7f6fd-5ff4-4371-a0df-9b409297b2cd service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:05.926416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7f6fd-5ff4-4371-a0df-9b409297b2cd service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:05.927976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7f6fd-5ff4-4371-a0df-9b409297b2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:05.952392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7f6fd-5ff4-4371-a0df-9b409297b2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:05.955331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7f6fd-5ff4-4371-a0df-9b409297b2cd service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:05.980309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:06.001945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 927/1851] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:06.007488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7f6fd-5ff4-4371-a0df-9b409297b2cd service nova] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:06.047547 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7f6fd-5ff4-4371-a0df-9b409297b2cd service nova] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:06.061850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f35d1f-d0b8-4e6b-80fe-0c6f0120fb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:06.063222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f35d1f-d0b8-4e6b-80fe-0c6f0120fb46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:06.064945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f35d1f-d0b8-4e6b-80fe-0c6f0120fb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:06.064945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f35d1f-d0b8-4e6b-80fe-0c6f0120fb46 admin admin] PATH_INFO: `/v3/projects/74249db2f020427ab4815b6e293305a4/users/1a04c2d384824cfea562a37f5db084d3/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:06.075406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b1346-252b-4934-a546-be14b5077b2b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:06.094915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3b9c2-655f-4c15-8dd4-88427600ef03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:06.095646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b9c2-655f-4c15-8dd4-88427600ef03 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:06.095980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b9c2-655f-4c15-8dd4-88427600ef03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:06.096501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b9c2-655f-4c15-8dd4-88427600ef03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:06.100314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-79a3b9c2-655f-4c15-8dd4-88427600ef03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:06.117428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f35d1f-d0b8-4e6b-80fe-0c6f0120fb46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74249db2f020427ab4815b6e293305a4, user_id=1a04c2d384824cfea562a37f5db084d3, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:06.120951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f35d1f-d0b8-4e6b-80fe-0c6f0120fb46 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:06.154045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 928/1852] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:06 2022] PUT /identity/v3/projects/74249db2f020427ab4815b6e293305a4/users/1a04c2d384824cfea562a37f5db084d3/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:06.156428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f35d1f-d0b8-4e6b-80fe-0c6f0120fb46 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:06.284292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3b9c2-655f-4c15-8dd4-88427600ef03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:06.286069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3b9c2-655f-4c15-8dd4-88427600ef03 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:06.327645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 925/1853] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:06.331306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130ef13-ce59-41df-9145-f851d1794926 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:06.331866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130ef13-ce59-41df-9145-f851d1794926 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:06.333014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130ef13-ce59-41df-9145-f851d1794926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:06.338794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f35d1f-d0b8-4e6b-80fe-0c6f0120fb46 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:06.364510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '935df3d211ec4840b40e3782e9f0cf3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd66c173139bd42808894c127d94f3c73', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:06.365186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:06.365476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:06.365745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] PATH_INFO: `/v3/projects/06b2e06820614870a6bd6fc50954944a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:06.374031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: Authorizing `identity:delete_project(project_id=06b2e06820614870a6bd6fc50954944a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:06.375923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:06.377702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:06.414375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e130ef13-ce59-41df-9145-f851d1794926 None None] MFA Rules not processed for user `1a04c2d384824cfea562a37f5db084d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:06.421396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e130ef13-ce59-41df-9145-f851d1794926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:06.548051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b2e06820614870a6bd6fc50954944a', 'request_id': 'req-e6af5b0c-60a2-425c-bc2e-adacc0662787'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:06.563287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b2e06820614870a6bd6fc50954944a', 'request_id': 'req-e6af5b0c-60a2-425c-bc2e-adacc0662787'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:06.581195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 926/1854] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:06.587367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130ef13-ce59-41df-9145-f851d1794926 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:06.592979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b2e06820614870a6bd6fc50954944a', 'request_id': 'req-e6af5b0c-60a2-425c-bc2e-adacc0662787'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:06.654082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] The token cache is being invalidate because project 06b2e06820614870a6bd6fc50954944a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:06.654382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:06.655938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:06.658478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 929/1855] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:06 2022] DELETE /identity/v3/projects/06b2e06820614870a6bd6fc50954944a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:06.838097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130ef13-ce59-41df-9145-f851d1794926 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.090823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde47e-c8d5-4b02-b7fc-3ada39228c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:07.091907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde47e-c8d5-4b02-b7fc-3ada39228c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.092414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde47e-c8d5-4b02-b7fc-3ada39228c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.092775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde47e-c8d5-4b02-b7fc-3ada39228c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.095480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbde47e-c8d5-4b02-b7fc-3ada39228c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.100808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbde47e-c8d5-4b02-b7fc-3ada39228c2d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.256572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 927/1856] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:06 2022] POST /identity/v3/projects => generated 367 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:07.259539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.261883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:07.292323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af5b0c-60a2-425c-bc2e-adacc0662787 tempest-VolumeQuotaClassesTest-259211060 tempest-VolumeQuotaClassesTest-259211060-project-admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.456089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c2583-cb37-4fa6-ac62-c67bc4498f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:07.457152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c2583-cb37-4fa6-ac62-c67bc4498f83 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.457152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c2583-cb37-4fa6-ac62-c67bc4498f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.457483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c2583-cb37-4fa6-ac62-c67bc4498f83 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.458126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c2583-cb37-4fa6-ac62-c67bc4498f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.460075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c2583-cb37-4fa6-ac62-c67bc4498f83 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.480593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:07.511916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 930/1857] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:07 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:07.514987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde47e-c8d5-4b02-b7fc-3ada39228c2d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.532082 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde47e-c8d5-4b02-b7fc-3ada39228c2d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.533821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c2583-cb37-4fa6-ac62-c67bc4498f83 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.535900 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4b9c2583-cb37-4fa6-ac62-c67bc4498f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:07.556321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c2583-cb37-4fa6-ac62-c67bc4498f83 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.556783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4965eec-721b-43e8-b86d-b8b2a6929d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:07.557415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4965eec-721b-43e8-b86d-b8b2a6929d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.558214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4965eec-721b-43e8-b86d-b8b2a6929d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.558654 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4965eec-721b-43e8-b86d-b8b2a6929d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.559309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4965eec-721b-43e8-b86d-b8b2a6929d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.562355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4965eec-721b-43e8-b86d-b8b2a6929d1a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.565571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:07.568594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.569178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.569665 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] PATH_INFO: `/v3/users/a13bc9724f0447e299a952ef4328c6a8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.571788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13bc9724f0447e299a952ef4328c6a8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.575717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.580671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 928/1858] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:07.585813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4965eec-721b-43e8-b86d-b8b2a6929d1a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.604170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4965eec-721b-43e8-b86d-b8b2a6929d1a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.611133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c12ed8-8a87-47ea-93b7-54bb5264f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:07.611835 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c12ed8-8a87-47ea-93b7-54bb5264f5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.612234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c12ed8-8a87-47ea-93b7-54bb5264f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.612508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c12ed8-8a87-47ea-93b7-54bb5264f5bc admin admin] PATH_INFO: `/v3/projects/8dff0239e4b64a2490c6d1b521923dc5/users/1729e165ee654162b46b3a245c4e47fd/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.634184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c12ed8-8a87-47ea-93b7-54bb5264f5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dff0239e4b64a2490c6d1b521923dc5, user_id=1729e165ee654162b46b3a245c4e47fd, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.638686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c12ed8-8a87-47ea-93b7-54bb5264f5bc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.642866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:07.658422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13bc9724f0447e299a952ef4328c6a8'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:07.661884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 929/1859] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:07 2022] PUT /identity/v3/projects/8dff0239e4b64a2490c6d1b521923dc5/users/1729e165ee654162b46b3a245c4e47fd/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:07.666460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c12ed8-8a87-47ea-93b7-54bb5264f5bc admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.670800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13bc9724f0447e299a952ef4328c6a8'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:07.671555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13bc9724f0447e299a952ef4328c6a8'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:07.676241 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13bc9724f0447e299a952ef4328c6a8'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:07.687299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13bc9724f0447e299a952ef4328c6a8'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:07.722720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 931/1860] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:07 2022] DELETE /identity/v3/users/a13bc9724f0447e299a952ef4328c6a8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:07.723648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.725144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:07.778535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c12ed8-8a87-47ea-93b7-54bb5264f5bc admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.859161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8b38-d9b9-4e6c-8a9b-fc2b43a76b47 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.869973 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87f2ad-d8ec-4fa2-ac33-5d72df614d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:07.871449 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f2ad-d8ec-4fa2-ac33-5d72df614d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.876660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f2ad-d8ec-4fa2-ac33-5d72df614d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.876660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f2ad-d8ec-4fa2-ac33-5d72df614d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.876660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87f2ad-d8ec-4fa2-ac33-5d72df614d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.876660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87f2ad-d8ec-4fa2-ac33-5d72df614d5e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.878959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:07.881314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.881899 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.882374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] PATH_INFO: `/v3/projects/afc4fb386c1640d8b9e1d1290db04c26` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.884148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc4fb386c1640d8b9e1d1290db04c26)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.887392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.895175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 930/1861] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:07.895175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81336752-65ed-4058-918d-6cade48df6fa None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.895175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81336752-65ed-4058-918d-6cade48df6fa None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.895607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81336752-65ed-4058-918d-6cade48df6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.922347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-81336752-65ed-4058-918d-6cade48df6fa None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:07.924841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-81336752-65ed-4058-918d-6cade48df6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:07.938279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 931/1862] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:07.939223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81336752-65ed-4058-918d-6cade48df6fa None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.942182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-81336752-65ed-4058-918d-6cade48df6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:07.960586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81336752-65ed-4058-918d-6cade48df6fa None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.984223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc4fb386c1640d8b9e1d1290db04c26', 'request_id': 'req-5c999b10-335e-4347-b468-337d1a84d341'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:07.991873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc4fb386c1640d8b9e1d1290db04c26', 'request_id': 'req-5c999b10-335e-4347-b468-337d1a84d341'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.003006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc4fb386c1640d8b9e1d1290db04c26', 'request_id': 'req-5c999b10-335e-4347-b468-337d1a84d341'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.013906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:08.021020 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] The token cache is being invalidate because project afc4fb386c1640d8b9e1d1290db04c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:08.021745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.023143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.026626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 932/1863] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:07 2022] DELETE /identity/v3/projects/afc4fb386c1640d8b9e1d1290db04c26 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:08.028074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.031164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.047015 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b65eab-1197-4828-bd93-06c736938030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.047881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b65eab-1197-4828-bd93-06c736938030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.048781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b65eab-1197-4828-bd93-06c736938030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.049281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b65eab-1197-4828-bd93-06c736938030 admin admin] PATH_INFO: `/v3/projects/8dff0239e4b64a2490c6d1b521923dc5/users/1729e165ee654162b46b3a245c4e47fd/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.051754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b65eab-1197-4828-bd93-06c736938030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dff0239e4b64a2490c6d1b521923dc5, user_id=1729e165ee654162b46b3a245c4e47fd, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.054957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b65eab-1197-4828-bd93-06c736938030 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.081264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 932/1864] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:07 2022] PUT /identity/v3/projects/8dff0239e4b64a2490c6d1b521923dc5/users/1729e165ee654162b46b3a245c4e47fd/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:08.082289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b65eab-1197-4828-bd93-06c736938030 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.090066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a6b65eab-1197-4828-bd93-06c736938030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.121196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c999b10-335e-4347-b468-337d1a84d341 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.145643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:08.180869 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b65eab-1197-4828-bd93-06c736938030 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.182841 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c7b16-988c-4345-8baa-fab99f9f55ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.184015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c7b16-988c-4345-8baa-fab99f9f55ee service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.184293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c7b16-988c-4345-8baa-fab99f9f55ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.184574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c7b16-988c-4345-8baa-fab99f9f55ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.186446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f31c7b16-988c-4345-8baa-fab99f9f55ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.187319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.187953 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.188282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.188562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] PATH_INFO: `/v3/users/985c6b0e329c4de58ddd206e42e9062b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.190338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=985c6b0e329c4de58ddd206e42e9062b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.192238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.199955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c7b16-988c-4345-8baa-fab99f9f55ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.201477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c7b16-988c-4345-8baa-fab99f9f55ee service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.214145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 933/1865] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:08.215704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e41d8-ad81-404f-86b2-ec1cab3431de None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.215993 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e41d8-ad81-404f-86b2-ec1cab3431de None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.216272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e41d8-ad81-404f-86b2-ec1cab3431de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.248837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-b89e41d8-ad81-404f-86b2-ec1cab3431de None None] MFA Rules not processed for user `1729e165ee654162b46b3a245c4e47fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:08.249722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985c6b0e329c4de58ddd206e42e9062b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.250856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b89e41d8-ad81-404f-86b2-ec1cab3431de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.259051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985c6b0e329c4de58ddd206e42e9062b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.259890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985c6b0e329c4de58ddd206e42e9062b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.260649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985c6b0e329c4de58ddd206e42e9062b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.270296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985c6b0e329c4de58ddd206e42e9062b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.296306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 933/1866] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:08 2022] DELETE /identity/v3/users/985c6b0e329c4de58ddd206e42e9062b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:08.337440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 934/1867] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:08.350406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.352237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.438805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029dfe6-3134-433a-9375-c68a27112e02 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.444269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2f250-537b-42ea-8838-8776ddae6b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.445099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f250-537b-42ea-8838-8776ddae6b40 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.445928 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f250-537b-42ea-8838-8776ddae6b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.446336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f250-537b-42ea-8838-8776ddae6b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.527064 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:08.529483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2f250-537b-42ea-8838-8776ddae6b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.531133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2f250-537b-42ea-8838-8776ddae6b40 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.554576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 934/1868] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:08.586732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e41d8-ad81-404f-86b2-ec1cab3431de None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.588375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b89e41d8-ad81-404f-86b2-ec1cab3431de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.596788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2f250-537b-42ea-8838-8776ddae6b40 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.608928 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2f250-537b-42ea-8838-8776ddae6b40 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.615312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338f874-bce8-4cdb-b53f-4d666b440b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.616069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338f874-bce8-4cdb-b53f-4d666b440b5a service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.616446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338f874-bce8-4cdb-b53f-4d666b440b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.616893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338f874-bce8-4cdb-b53f-4d666b440b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.626621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e41d8-ad81-404f-86b2-ec1cab3431de None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.631347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6338f874-bce8-4cdb-b53f-4d666b440b5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.699982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:08.720775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.721434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.721703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.721975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] PATH_INFO: `/v3/projects/7ee66e63647d4e5ca3cbdd7f799815fc` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.723203 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee66e63647d4e5ca3cbdd7f799815fc)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.725334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.747111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338f874-bce8-4cdb-b53f-4d666b440b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.748583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338f874-bce8-4cdb-b53f-4d666b440b5a service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.759145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 935/1869] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:08.760163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338f874-bce8-4cdb-b53f-4d666b440b5a service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.762364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6338f874-bce8-4cdb-b53f-4d666b440b5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.793228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338f874-bce8-4cdb-b53f-4d666b440b5a service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.803778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee66e63647d4e5ca3cbdd7f799815fc', 'request_id': 'req-a9f04e61-6689-436f-88c6-1a0cb58838d5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.813863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee66e63647d4e5ca3cbdd7f799815fc', 'request_id': 'req-a9f04e61-6689-436f-88c6-1a0cb58838d5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.824457 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee66e63647d4e5ca3cbdd7f799815fc', 'request_id': 'req-a9f04e61-6689-436f-88c6-1a0cb58838d5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.839736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] The token cache is being invalidate because project 7ee66e63647d4e5ca3cbdd7f799815fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:08.840285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.841031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.845731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 935/1870] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:08 2022] DELETE /identity/v3/projects/7ee66e63647d4e5ca3cbdd7f799815fc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:08.847874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.853087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.877157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.880962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.880962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.880962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] PATH_INFO: `/v3/projects/86547f7fd67444e0a898a7e7d2dc5ca2` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.882890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86547f7fd67444e0a898a7e7d2dc5ca2)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.885415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.943878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04e61-6689-436f-88c6-1a0cb58838d5 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.962491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86547f7fd67444e0a898a7e7d2dc5ca2', 'request_id': 'req-504e841d-8e17-46c8-a43a-8b48b006d0c0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.972153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86547f7fd67444e0a898a7e7d2dc5ca2', 'request_id': 'req-504e841d-8e17-46c8-a43a-8b48b006d0c0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:08.982551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86547f7fd67444e0a898a7e7d2dc5ca2', 'request_id': 'req-504e841d-8e17-46c8-a43a-8b48b006d0c0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.002338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] The token cache is being invalidate because project 86547f7fd67444e0a898a7e7d2dc5ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:09.002801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.003537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-504e841d-8e17-46c8-a43a-8b48b006d0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.005900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 936/1871] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:08 2022] DELETE /identity/v3/projects/86547f7fd67444e0a898a7e7d2dc5ca2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:09.012162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99847471-7cc3-413b-85a3-ba2a9458bc26 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.012521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99847471-7cc3-413b-85a3-ba2a9458bc26 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.013361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99847471-7cc3-413b-85a3-ba2a9458bc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.045740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.046650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.047395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.047395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] PATH_INFO: `/v3/users/935df3d211ec4840b40e3782e9f0cf3e` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.048934 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=935df3d211ec4840b40e3782e9f0cf3e)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.051708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.054868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-99847471-7cc3-413b-85a3-ba2a9458bc26 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:09.056352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-99847471-7cc3-413b-85a3-ba2a9458bc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.066931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 937/1872] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:09.077454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963faf8-2a39-4081-a94d-14703fd00a3a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.077904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963faf8-2a39-4081-a94d-14703fd00a3a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.078278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963faf8-2a39-4081-a94d-14703fd00a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.102388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7963faf8-2a39-4081-a94d-14703fd00a3a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:09.103697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7963faf8-2a39-4081-a94d-14703fd00a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.121299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 938/1873] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:09.122449 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963faf8-2a39-4081-a94d-14703fd00a3a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:09.125230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:09.145659 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963faf8-2a39-4081-a94d-14703fd00a3a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.170473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dbcb3-d7b0-40cc-8d53-f3aaa632f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.170473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dbcb3-d7b0-40cc-8d53-f3aaa632f2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.170473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dbcb3-d7b0-40cc-8d53-f3aaa632f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.170473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dbcb3-d7b0-40cc-8d53-f3aaa632f2eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.170977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dbcb3-d7b0-40cc-8d53-f3aaa632f2eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:09.170977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dbcb3-d7b0-40cc-8d53-f3aaa632f2eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.170977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dbcb3-d7b0-40cc-8d53-f3aaa632f2eb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.181222 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:09.193030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 939/1874] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:09.193900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dbcb3-d7b0-40cc-8d53-f3aaa632f2eb admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:09.201187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935df3d211ec4840b40e3782e9f0cf3e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.211716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dbcb3-d7b0-40cc-8d53-f3aaa632f2eb admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.213620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935df3d211ec4840b40e3782e9f0cf3e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.214670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935df3d211ec4840b40e3782e9f0cf3e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.215890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935df3d211ec4840b40e3782e9f0cf3e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.218096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6974a43-c0b1-4fba-862d-31511eeff445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.219033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974a43-c0b1-4fba-862d-31511eeff445 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.219317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974a43-c0b1-4fba-862d-31511eeff445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.219672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974a43-c0b1-4fba-862d-31511eeff445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.220400 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6974a43-c0b1-4fba-862d-31511eeff445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.223510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6974a43-c0b1-4fba-862d-31511eeff445 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.233892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935df3d211ec4840b40e3782e9f0cf3e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.276164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 940/1875] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:09 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:09.283357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6974a43-c0b1-4fba-862d-31511eeff445 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:09.286310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f6974a43-c0b1-4fba-862d-31511eeff445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.288101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 936/1876] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:08 2022] DELETE /identity/v3/users/935df3d211ec4840b40e3782e9f0cf3e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:09.419053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6974a43-c0b1-4fba-862d-31511eeff445 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.548364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0422b1-336a-49a0-9ba8-af864a374d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.549020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0422b1-336a-49a0-9ba8-af864a374d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.549346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0422b1-336a-49a0-9ba8-af864a374d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.549618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0422b1-336a-49a0-9ba8-af864a374d4a admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.550247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0422b1-336a-49a0-9ba8-af864a374d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.552511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0422b1-336a-49a0-9ba8-af864a374d4a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.576206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 941/1877] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:09 2022] POST /identity/v3/users => generated 294 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:09.580364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:09.591497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507eea49-4de7-45a2-908b-dcfb5d9394ea admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.596445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00836556-6b86-4255-a507-0f80bdc95810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.597289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00836556-6b86-4255-a507-0f80bdc95810 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.597715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00836556-6b86-4255-a507-0f80bdc95810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.597990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00836556-6b86-4255-a507-0f80bdc95810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.598705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00836556-6b86-4255-a507-0f80bdc95810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.600410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00836556-6b86-4255-a507-0f80bdc95810 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.612984 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 937/1878] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:09.617950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0422b1-336a-49a0-9ba8-af864a374d4a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:09.629392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0422b1-336a-49a0-9ba8-af864a374d4a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.634115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574725eb-7ee7-41b0-ae8e-b0e2e22a60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.634727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574725eb-7ee7-41b0-ae8e-b0e2e22a60f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.635007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574725eb-7ee7-41b0-ae8e-b0e2e22a60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.635338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574725eb-7ee7-41b0-ae8e-b0e2e22a60f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.636214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574725eb-7ee7-41b0-ae8e-b0e2e22a60f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.638106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574725eb-7ee7-41b0-ae8e-b0e2e22a60f0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.651168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 942/1879] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:09.655679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00836556-6b86-4255-a507-0f80bdc95810 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:09.662981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574725eb-7ee7-41b0-ae8e-b0e2e22a60f0 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:09.664763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-574725eb-7ee7-41b0-ae8e-b0e2e22a60f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.666136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00836556-6b86-4255-a507-0f80bdc95810 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.682036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf429a1-01f1-4d7f-b5a2-8a3a60613033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.683331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf429a1-01f1-4d7f-b5a2-8a3a60613033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.683599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf429a1-01f1-4d7f-b5a2-8a3a60613033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.683866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf429a1-01f1-4d7f-b5a2-8a3a60613033 admin admin] PATH_INFO: `/v3/projects/d350e4f32523494484905d6751ef6323/users/7219543c1cf8433e85db7eeaa7318a0e/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.691516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574725eb-7ee7-41b0-ae8e-b0e2e22a60f0 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.697813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.699592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.700038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.700488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] PATH_INFO: `/v3/projects/d66c173139bd42808894c127d94f3c73` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.702103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66c173139bd42808894c127d94f3c73)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.704874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.708879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf429a1-01f1-4d7f-b5a2-8a3a60613033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d350e4f32523494484905d6751ef6323, user_id=7219543c1cf8433e85db7eeaa7318a0e, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.711625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf429a1-01f1-4d7f-b5a2-8a3a60613033 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.726747 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 938/1880] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:09 2022] PUT /identity/v3/projects/d350e4f32523494484905d6751ef6323/users/7219543c1cf8433e85db7eeaa7318a0e/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:09.737380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b1b5a-349a-424d-b03b-9b29eaa932c9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.737753 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b1b5a-349a-424d-b03b-9b29eaa932c9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.738174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b1b5a-349a-424d-b03b-9b29eaa932c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.767840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66c173139bd42808894c127d94f3c73', 'request_id': 'req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.772204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d21b1b5a-349a-424d-b03b-9b29eaa932c9 None None] MFA Rules not processed for user `7219543c1cf8433e85db7eeaa7318a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:09.773481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d21b1b5a-349a-424d-b03b-9b29eaa932c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.773644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:09.777637 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66c173139bd42808894c127d94f3c73', 'request_id': 'req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.790369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66c173139bd42808894c127d94f3c73', 'request_id': 'req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.809099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] The token cache is being invalidate because project d66c173139bd42808894c127d94f3c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:09.809437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.810062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-56361b7c-bf1b-46e2-9e1a-e14d0cc47dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:09.813579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 943/1881] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:09 2022] DELETE /identity/v3/projects/d66c173139bd42808894c127d94f3c73 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:09.819815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e26995-68ef-45a9-aad3-be1d9834fc59 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.820124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e26995-68ef-45a9-aad3-be1d9834fc59 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.820372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e26995-68ef-45a9-aad3-be1d9834fc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.855145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-11e26995-68ef-45a9-aad3-be1d9834fc59 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:09.856460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-11e26995-68ef-45a9-aad3-be1d9834fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.864159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 939/1882] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:09.870274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b1b5a-349a-424d-b03b-9b29eaa932c9 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:09.872115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d21b1b5a-349a-424d-b03b-9b29eaa932c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.948113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 944/1883] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:09.957174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327167a-46a8-4ea8-bd16-ce67bb69abcc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.957470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327167a-46a8-4ea8-bd16-ce67bb69abcc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.957748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327167a-46a8-4ea8-bd16-ce67bb69abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.959363 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:09.981971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9327167a-46a8-4ea8-bd16-ce67bb69abcc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:09.982184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b1b5a-349a-424d-b03b-9b29eaa932c9 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.983321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9327167a-46a8-4ea8-bd16-ce67bb69abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.988570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b8ee-9fce-46ca-b728-8c3465810227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.989459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b8ee-9fce-46ca-b728-8c3465810227 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.989835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b8ee-9fce-46ca-b728-8c3465810227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.990207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b8ee-9fce-46ca-b728-8c3465810227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.990968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b8ee-9fce-46ca-b728-8c3465810227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.993477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 945/1884] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:09.994832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b8ee-9fce-46ca-b728-8c3465810227 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.997982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327167a-46a8-4ea8-bd16-ce67bb69abcc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.008192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327167a-46a8-4ea8-bd16-ce67bb69abcc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.014035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9b04a-fbc2-4496-8618-d99521aa6e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.015100 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9b04a-fbc2-4496-8618-d99521aa6e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.015998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9b04a-fbc2-4496-8618-d99521aa6e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.016301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9b04a-fbc2-4496-8618-d99521aa6e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.017074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9b04a-fbc2-4496-8618-d99521aa6e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:10.017638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9b04a-fbc2-4496-8618-d99521aa6e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.019421 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9b04a-fbc2-4496-8618-d99521aa6e60 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.043198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 940/1885] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:09 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:10.047047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b8ee-9fce-46ca-b728-8c3465810227 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.047673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 946/1886] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:10.051948 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9b04a-fbc2-4496-8618-d99521aa6e60 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.073504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9b04a-fbc2-4496-8618-d99521aa6e60 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.164660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b8ee-9fce-46ca-b728-8c3465810227 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.179591 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5d1b4-f643-41fc-a4ae-88cc58686609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.180174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5d1b4-f643-41fc-a4ae-88cc58686609 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.180989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5d1b4-f643-41fc-a4ae-88cc58686609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.181328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5d1b4-f643-41fc-a4ae-88cc58686609 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.182043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5d1b4-f643-41fc-a4ae-88cc58686609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.184096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5d1b4-f643-41fc-a4ae-88cc58686609 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.190028 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40960-6a57-48ac-b75e-9e2097ac6191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.190848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40960-6a57-48ac-b75e-9e2097ac6191 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.191180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40960-6a57-48ac-b75e-9e2097ac6191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.191450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40960-6a57-48ac-b75e-9e2097ac6191 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.192277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40960-6a57-48ac-b75e-9e2097ac6191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.194703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40960-6a57-48ac-b75e-9e2097ac6191 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.219495 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 941/1887] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:10 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:10.221396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5d1b4-f643-41fc-a4ae-88cc58686609 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.236022 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5d1b4-f643-41fc-a4ae-88cc58686609 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.242334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 947/1888] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:10 2022] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:10.242483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777de09a-9c63-4e20-b936-d01d3128b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.243172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de09a-9c63-4e20-b936-d01d3128b673 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.243429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40960-6a57-48ac-b75e-9e2097ac6191 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.243551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de09a-9c63-4e20-b936-d01d3128b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.243704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de09a-9c63-4e20-b936-d01d3128b673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.244438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777de09a-9c63-4e20-b936-d01d3128b673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.247473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777de09a-9c63-4e20-b936-d01d3128b673 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.267520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 942/1889] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:10.271588 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777de09a-9c63-4e20-b936-d01d3128b673 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.290118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777de09a-9c63-4e20-b936-d01d3128b673 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.324323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:10.337807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40960-6a57-48ac-b75e-9e2097ac6191 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.344517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71961d98-621b-45c5-ae97-f434402dca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.345430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71961d98-621b-45c5-ae97-f434402dca2f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.345777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71961d98-621b-45c5-ae97-f434402dca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.346148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71961d98-621b-45c5-ae97-f434402dca2f admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.346831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71961d98-621b-45c5-ae97-f434402dca2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.348944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71961d98-621b-45c5-ae97-f434402dca2f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.373446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc198484-e16d-419e-80a3-bfbf6a69fb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.374289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc198484-e16d-419e-80a3-bfbf6a69fb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.374704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc198484-e16d-419e-80a3-bfbf6a69fb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.375105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc198484-e16d-419e-80a3-bfbf6a69fb56 admin admin] PATH_INFO: `/v3/projects/03eef5691dcf4e7f86a7288d316370b3/users/9e22254379be4a4782765dd918ea6afd/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.381111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 948/1890] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:10 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:10.382076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71961d98-621b-45c5-ae97-f434402dca2f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.393313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71961d98-621b-45c5-ae97-f434402dca2f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.399418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc198484-e16d-419e-80a3-bfbf6a69fb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03eef5691dcf4e7f86a7288d316370b3, user_id=9e22254379be4a4782765dd918ea6afd, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.402703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc198484-e16d-419e-80a3-bfbf6a69fb56 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.408595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ad609-e0ce-4be6-a009-153359574732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.409260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ad609-e0ce-4be6-a009-153359574732 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.409559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ad609-e0ce-4be6-a009-153359574732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.409877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ad609-e0ce-4be6-a009-153359574732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.410531 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ad609-e0ce-4be6-a009-153359574732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.412399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ad609-e0ce-4be6-a009-153359574732 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.420435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 943/1891] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:10 2022] PUT /identity/v3/projects/03eef5691dcf4e7f86a7288d316370b3/users/9e22254379be4a4782765dd918ea6afd/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:10.424352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc198484-e16d-419e-80a3-bfbf6a69fb56 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.428733 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 949/1892] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:10.437916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ad609-e0ce-4be6-a009-153359574732 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.449425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ad609-e0ce-4be6-a009-153359574732 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.481259 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:10.530265 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60583032-83d8-4098-ba5a-9c76c724f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.531215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60583032-83d8-4098-ba5a-9c76c724f1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.531588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60583032-83d8-4098-ba5a-9c76c724f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.531989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60583032-83d8-4098-ba5a-9c76c724f1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.533306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60583032-83d8-4098-ba5a-9c76c724f1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.534001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc198484-e16d-419e-80a3-bfbf6a69fb56 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.535112 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60583032-83d8-4098-ba5a-9c76c724f1f0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.552436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015b6a-5bc2-4d9f-a2ef-e5fae7ca6e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.553109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015b6a-5bc2-4d9f-a2ef-e5fae7ca6e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.553389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015b6a-5bc2-4d9f-a2ef-e5fae7ca6e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.553660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015b6a-5bc2-4d9f-a2ef-e5fae7ca6e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.554523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 950/1893] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:10.554645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c015b6a-5bc2-4d9f-a2ef-e5fae7ca6e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.555463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60583032-83d8-4098-ba5a-9c76c724f1f0 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.556144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c015b6a-5bc2-4d9f-a2ef-e5fae7ca6e65 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.570599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60583032-83d8-4098-ba5a-9c76c724f1f0 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.578983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6221e7-ff31-4a82-a44a-944cc6da7b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.580245 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6221e7-ff31-4a82-a44a-944cc6da7b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.580576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6221e7-ff31-4a82-a44a-944cc6da7b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.580893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6221e7-ff31-4a82-a44a-944cc6da7b4c admin admin] PATH_INFO: `/v3/projects/4ec2ef0358474f989dc5600cd420432e/users/9f3567e8f4644b97b71523d88a7d6b51/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.587770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 944/1894] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:10.588932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015b6a-5bc2-4d9f-a2ef-e5fae7ca6e65 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.600851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6221e7-ff31-4a82-a44a-944cc6da7b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec2ef0358474f989dc5600cd420432e, user_id=9f3567e8f4644b97b71523d88a7d6b51, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.603905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6221e7-ff31-4a82-a44a-944cc6da7b4c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.611736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015b6a-5bc2-4d9f-a2ef-e5fae7ca6e65 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.624303 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 951/1895] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:10 2022] PUT /identity/v3/projects/4ec2ef0358474f989dc5600cd420432e/users/9f3567e8f4644b97b71523d88a7d6b51/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:10.625661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf40e3f-ccdd-4fbd-bb38-679ffa70ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.627273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf40e3f-ccdd-4fbd-bb38-679ffa70ac0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.627554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf40e3f-ccdd-4fbd-bb38-679ffa70ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.627853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf40e3f-ccdd-4fbd-bb38-679ffa70ac0d admin admin] PATH_INFO: `/v3/projects/03eef5691dcf4e7f86a7288d316370b3/users/9e22254379be4a4782765dd918ea6afd/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.639534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf40e3f-ccdd-4fbd-bb38-679ffa70ac0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03eef5691dcf4e7f86a7288d316370b3, user_id=9e22254379be4a4782765dd918ea6afd, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.639872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0357a-93db-4b18-b717-cd0b1611d497 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.640483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0357a-93db-4b18-b717-cd0b1611d497 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.640792 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0357a-93db-4b18-b717-cd0b1611d497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.643604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf40e3f-ccdd-4fbd-bb38-679ffa70ac0d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.657028 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 945/1896] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:10 2022] PUT /identity/v3/projects/03eef5691dcf4e7f86a7288d316370b3/users/9e22254379be4a4782765dd918ea6afd/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:10.675578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa07fa-e0ce-4dcb-9e68-254ab501e53f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.676179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa07fa-e0ce-4dcb-9e68-254ab501e53f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.677027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa07fa-e0ce-4dcb-9e68-254ab501e53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.695935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-aed0357a-93db-4b18-b717-cd0b1611d497 None None] MFA Rules not processed for user `9f3567e8f4644b97b71523d88a7d6b51`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:10.697516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-aed0357a-93db-4b18-b717-cd0b1611d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:10.762032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-41fa07fa-e0ce-4dcb-9e68-254ab501e53f None None] MFA Rules not processed for user `9e22254379be4a4782765dd918ea6afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:10.764385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-41fa07fa-e0ce-4dcb-9e68-254ab501e53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:10.876487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 952/1897] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:10.881486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0357a-93db-4b18-b717-cd0b1611d497 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.882650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 946/1898] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:10.935193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:10.979939 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa07fa-e0ce-4dcb-9e68-254ab501e53f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.985159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0357a-93db-4b18-b717-cd0b1611d497 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.987377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-41fa07fa-e0ce-4dcb-9e68-254ab501e53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:10.997069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f56397-efa9-43ea-a036-965ca21d3b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.997837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f56397-efa9-43ea-a036-965ca21d3b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.998129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f56397-efa9-43ea-a036-965ca21d3b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.998402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f56397-efa9-43ea-a036-965ca21d3b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.999109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f56397-efa9-43ea-a036-965ca21d3b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.001103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f56397-efa9-43ea-a036-965ca21d3b08 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.040321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 953/1899] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:10 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:11.044593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f56397-efa9-43ea-a036-965ca21d3b08 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:11.090282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa07fa-e0ce-4dcb-9e68-254ab501e53f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:11.120750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f56397-efa9-43ea-a036-965ca21d3b08 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:11.126546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adc0e5-9a4f-4f24-ab24-de64168e3791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:11.127476 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc0e5-9a4f-4f24-ab24-de64168e3791 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.127962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc0e5-9a4f-4f24-ab24-de64168e3791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.128555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc0e5-9a4f-4f24-ab24-de64168e3791 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.129445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adc0e5-9a4f-4f24-ab24-de64168e3791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.131681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adc0e5-9a4f-4f24-ab24-de64168e3791 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.157836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5649fed-ef41-452b-a6c1-cfabda741e2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:11.158649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649fed-ef41-452b-a6c1-cfabda741e2b service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.159032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649fed-ef41-452b-a6c1-cfabda741e2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.159364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649fed-ef41-452b-a6c1-cfabda741e2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.162008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 954/1900] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:11 2022] POST /identity/v3/users => generated 302 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:11.165939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adc0e5-9a4f-4f24-ab24-de64168e3791 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:11.183438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adc0e5-9a4f-4f24-ab24-de64168e3791 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:11.183615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:11.188928 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad8927-0a3c-4738-8bc9-de9908dc3ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:11.189551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad8927-0a3c-4738-8bc9-de9908dc3ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.190498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad8927-0a3c-4738-8bc9-de9908dc3ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.190777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad8927-0a3c-4738-8bc9-de9908dc3ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.191796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad8927-0a3c-4738-8bc9-de9908dc3ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.194011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad8927-0a3c-4738-8bc9-de9908dc3ba4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.208800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 955/1901] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:11.211956 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad8927-0a3c-4738-8bc9-de9908dc3ba4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:11.224865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad8927-0a3c-4738-8bc9-de9908dc3ba4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:11.230412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5395c1-1f77-4a40-a859-6217d3e79775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:11.231232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5395c1-1f77-4a40-a859-6217d3e79775 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.231592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5395c1-1f77-4a40-a859-6217d3e79775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.231959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5395c1-1f77-4a40-a859-6217d3e79775 admin admin] PATH_INFO: `/v3/projects/352b72ede59e41aa931c2fbccfccf0d8/users/c45c816a0d644ecea7706cba75287e4a/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.239975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5649fed-ef41-452b-a6c1-cfabda741e2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.241602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5649fed-ef41-452b-a6c1-cfabda741e2b service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.248323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5395c1-1f77-4a40-a859-6217d3e79775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352b72ede59e41aa931c2fbccfccf0d8, user_id=c45c816a0d644ecea7706cba75287e4a, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.251050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5395c1-1f77-4a40-a859-6217d3e79775 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.255947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 947/1902] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:11.266104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 956/1903] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:11 2022] PUT /identity/v3/projects/352b72ede59e41aa931c2fbccfccf0d8/users/c45c816a0d644ecea7706cba75287e4a/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:11.268658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5649fed-ef41-452b-a6c1-cfabda741e2b service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:11.269778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5395c1-1f77-4a40-a859-6217d3e79775 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:11.270408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a5649fed-ef41-452b-a6c1-cfabda741e2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:11.285578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5649fed-ef41-452b-a6c1-cfabda741e2b service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:11.354709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5395c1-1f77-4a40-a859-6217d3e79775 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:11.359400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:11.360202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.360481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.360785 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] PATH_INFO: `/v3/users/8b4129783c6c409f955861384d315838` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.361482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfdbb0-f171-45df-a438-9985a2dd4945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:11.362543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfdbb0-f171-45df-a438-9985a2dd4945 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.362782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4129783c6c409f955861384d315838)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.363459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfdbb0-f171-45df-a438-9985a2dd4945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.364074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfdbb0-f171-45df-a438-9985a2dd4945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.365206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.365821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfdbb0-f171-45df-a438-9985a2dd4945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.367882 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfdbb0-f171-45df-a438-9985a2dd4945 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.388576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 957/1904] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:11.393162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfdbb0-f171-45df-a438-9985a2dd4945 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:11.406716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfdbb0-f171-45df-a438-9985a2dd4945 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:11.413114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966798a-70ae-4e00-9139-e889fc82574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:11.413798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966798a-70ae-4e00-9139-e889fc82574b admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.414180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966798a-70ae-4e00-9139-e889fc82574b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.414580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966798a-70ae-4e00-9139-e889fc82574b admin admin] PATH_INFO: `/v3/projects/352b72ede59e41aa931c2fbccfccf0d8/users/c45c816a0d644ecea7706cba75287e4a/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.417303 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966798a-70ae-4e00-9139-e889fc82574b admin admin] RBAC: Authorizing `identity:create_grant(project_id=352b72ede59e41aa931c2fbccfccf0d8, user_id=c45c816a0d644ecea7706cba75287e4a, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.420429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966798a-70ae-4e00-9139-e889fc82574b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.423376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:11.438812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 958/1905] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:11 2022] PUT /identity/v3/projects/352b72ede59e41aa931c2fbccfccf0d8/users/c45c816a0d644ecea7706cba75287e4a/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:11.447804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4129783c6c409f955861384d315838'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:11.450237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49e69-4a58-4755-bc51-e188bf396e85 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.450527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49e69-4a58-4755-bc51-e188bf396e85 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.450801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49e69-4a58-4755-bc51-e188bf396e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.457760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4129783c6c409f955861384d315838'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:11.458484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4129783c6c409f955861384d315838'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:11.459306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4129783c6c409f955861384d315838'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:11.470116 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d14c7214-9255-4c84-9616-ed3345e948f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4129783c6c409f955861384d315838'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:11.487778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d4f49e69-4a58-4755-bc51-e188bf396e85 None None] MFA Rules not processed for user `c45c816a0d644ecea7706cba75287e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:11.489086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d4f49e69-4a58-4755-bc51-e188bf396e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:11.496460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 948/1906] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:11 2022] DELETE /identity/v3/users/8b4129783c6c409f955861384d315838 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:11.500833 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb521b1-d3c2-48cf-9c0b-d12c1b6af4a5 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.501195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb521b1-d3c2-48cf-9c0b-d12c1b6af4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.501613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb521b1-d3c2-48cf-9c0b-d12c1b6af4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.525281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-eeb521b1-d3c2-48cf-9c0b-d12c1b6af4a5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:11.527075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-eeb521b1-d3c2-48cf-9c0b-d12c1b6af4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:11.557104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:11.598186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 959/1907] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:11.604085 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 949/1908] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:11.616142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f49e69-4a58-4755-bc51-e188bf396e85 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:11.617828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d4f49e69-4a58-4755-bc51-e188bf396e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:11.638539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb521b1-d3c2-48cf-9c0b-d12c1b6af4a5 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:11.640215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-eeb521b1-d3c2-48cf-9c0b-d12c1b6af4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:11.700098 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f49e69-4a58-4755-bc51-e188bf396e85 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:11.725626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb521b1-d3c2-48cf-9c0b-d12c1b6af4a5 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:11.731144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f081-1be9-4628-87ed-eb766e314ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:11.731807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f081-1be9-4628-87ed-eb766e314ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.732293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f081-1be9-4628-87ed-eb766e314ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.732599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f081-1be9-4628-87ed-eb766e314ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.769175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5c74b-decf-4673-90f8-253e38d768d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:11.770441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5c74b-decf-4673-90f8-253e38d768d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.771039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5c74b-decf-4673-90f8-253e38d768d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.771503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5c74b-decf-4673-90f8-253e38d768d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.785285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5c74b-decf-4673-90f8-253e38d768d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.787164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5c74b-decf-4673-90f8-253e38d768d0 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.798932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 960/1909] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:11.842353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7f081-1be9-4628-87ed-eb766e314ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.842353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7f081-1be9-4628-87ed-eb766e314ac6 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.854073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 950/1910] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:11.977145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5c74b-decf-4673-90f8-253e38d768d0 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:11.990328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5c74b-decf-4673-90f8-253e38d768d0 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:12.004099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362c912-b212-4f9b-a0c0-e8bf2caacf59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:12.004760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362c912-b212-4f9b-a0c0-e8bf2caacf59 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:12.005045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362c912-b212-4f9b-a0c0-e8bf2caacf59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:12.005317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362c912-b212-4f9b-a0c0-e8bf2caacf59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:12.018705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5362c912-b212-4f9b-a0c0-e8bf2caacf59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:12.113295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:12.193664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362c912-b212-4f9b-a0c0-e8bf2caacf59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:12.196996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362c912-b212-4f9b-a0c0-e8bf2caacf59 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:12.212659 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 961/1911] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:12.287544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f081-1be9-4628-87ed-eb766e314ac6 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:12.289315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-90c7f081-1be9-4628-87ed-eb766e314ac6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:12.317523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f081-1be9-4628-87ed-eb766e314ac6 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:12.328976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:12.330190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:12.333944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:12.334434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] PATH_INFO: `/v3/users/7219543c1cf8433e85db7eeaa7318a0e` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:12.337948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7219543c1cf8433e85db7eeaa7318a0e)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:12.344728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:12.498868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7219543c1cf8433e85db7eeaa7318a0e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:12.513014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7219543c1cf8433e85db7eeaa7318a0e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:12.516234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7219543c1cf8433e85db7eeaa7318a0e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:12.518062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7219543c1cf8433e85db7eeaa7318a0e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:12.537825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7219543c1cf8433e85db7eeaa7318a0e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:12.577456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:12.607002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 951/1912] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:12 2022] DELETE /identity/v3/users/7219543c1cf8433e85db7eeaa7318a0e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:12.612094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59516502-ebc8-4b77-90c0-926a31fc7268 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:12.612387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59516502-ebc8-4b77-90c0-926a31fc7268 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:12.612700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59516502-ebc8-4b77-90c0-926a31fc7268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:12.651593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-59516502-ebc8-4b77-90c0-926a31fc7268 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:12.652872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-59516502-ebc8-4b77-90c0-926a31fc7268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:12.775744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:12.778447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:12.890172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 962/1913] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:12.907600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59516502-ebc8-4b77-90c0-926a31fc7268 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:12.921437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-59516502-ebc8-4b77-90c0-926a31fc7268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:12.992117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6660b9-358e-4baa-93f9-b6dfbff7b181 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:13.011518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:13.012229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:13.012509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:13.012818 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] PATH_INFO: `/v3/projects/ce9a61dc2a034a95b620b5cebcec00af` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:13.014068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9a61dc2a034a95b620b5cebcec00af)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:13.017202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:13.025705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59516502-ebc8-4b77-90c0-926a31fc7268 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:13.039538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff9800-ce10-4113-8516-73a1308a2e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:13.041541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9800-ce10-4113-8516-73a1308a2e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:13.044935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9800-ce10-4113-8516-73a1308a2e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:13.045390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9800-ce10-4113-8516-73a1308a2e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:13.075196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff9800-ce10-4113-8516-73a1308a2e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:13.076804 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff9800-ce10-4113-8516-73a1308a2e4a service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:13.113491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 963/1914] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:13.131004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9a61dc2a034a95b620b5cebcec00af', 'request_id': 'req-d0a1bed9-c50e-4caf-b195-2a9993db98b2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.161952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9a61dc2a034a95b620b5cebcec00af', 'request_id': 'req-d0a1bed9-c50e-4caf-b195-2a9993db98b2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.181786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9a61dc2a034a95b620b5cebcec00af', 'request_id': 'req-d0a1bed9-c50e-4caf-b195-2a9993db98b2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.216368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] The token cache is being invalidate because project ce9a61dc2a034a95b620b5cebcec00af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:13.216613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.218950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.225599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 952/1915] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:12 2022] DELETE /identity/v3/projects/ce9a61dc2a034a95b620b5cebcec00af => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:13.229588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff9800-ce10-4113-8516-73a1308a2e4a service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:13.244861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff9800-ce10-4113-8516-73a1308a2e4a service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:13.377695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:13.379061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:13.379363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:13.380730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] PATH_INFO: `/v3/users/fb012f40a9b348b8a42e351d26df942a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:13.383232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb012f40a9b348b8a42e351d26df942a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:13.387773 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:13.441295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:13.484691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:13.484691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:13.497223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb012f40a9b348b8a42e351d26df942a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.506177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1bed9-c50e-4caf-b195-2a9993db98b2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:13.509427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb012f40a9b348b8a42e351d26df942a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.510674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb012f40a9b348b8a42e351d26df942a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.512281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb012f40a9b348b8a42e351d26df942a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.522315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-1712b681-778c-42a8-a819-4e8c9e32211b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb012f40a9b348b8a42e351d26df942a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.523374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:13.524349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:13.524807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:13.525219 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] PATH_INFO: `/v3/users/1a04c2d384824cfea562a37f5db084d3` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:13.531309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a04c2d384824cfea562a37f5db084d3)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:13.533990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:13.546822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 964/1916] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:13 2022] DELETE /identity/v3/users/fb012f40a9b348b8a42e351d26df942a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:13.592906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a04c2d384824cfea562a37f5db084d3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.601988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a04c2d384824cfea562a37f5db084d3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.602675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a04c2d384824cfea562a37f5db084d3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.603281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a04c2d384824cfea562a37f5db084d3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.612953 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a04c2d384824cfea562a37f5db084d3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:13.629072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:13.635652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 953/1917] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:13 2022] DELETE /identity/v3/users/1a04c2d384824cfea562a37f5db084d3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:13.640071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d55c5-55af-49bc-9648-f2b7db4ac9d5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:13.640352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d55c5-55af-49bc-9648-f2b7db4ac9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:13.640644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d55c5-55af-49bc-9648-f2b7db4ac9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:13.669434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-748d55c5-55af-49bc-9648-f2b7db4ac9d5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:13.670686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-748d55c5-55af-49bc-9648-f2b7db4ac9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:13.744373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 965/1918] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:13.774198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:13.775644 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:13.884797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa2f30-ac47-414a-9836-0aeaf32b1381 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:13.888166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0554efd-4107-4150-8421-78a11fc16630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:13.888855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0554efd-4107-4150-8421-78a11fc16630 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:13.889423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0554efd-4107-4150-8421-78a11fc16630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:13.889423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0554efd-4107-4150-8421-78a11fc16630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:13.904610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0554efd-4107-4150-8421-78a11fc16630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:13.907096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0554efd-4107-4150-8421-78a11fc16630 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:13.924024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 954/1919] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:14.168533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d55c5-55af-49bc-9648-f2b7db4ac9d5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:14.170807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-748d55c5-55af-49bc-9648-f2b7db4ac9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:14.197707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d55c5-55af-49bc-9648-f2b7db4ac9d5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:14.213864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:14.214905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:14.215238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:14.215560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] PATH_INFO: `/v3/projects/d350e4f32523494484905d6751ef6323` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:14.218737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d350e4f32523494484905d6751ef6323)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:14.222536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:14.339879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd350e4f32523494484905d6751ef6323', 'request_id': 'req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.353472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd350e4f32523494484905d6751ef6323', 'request_id': 'req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.368680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd350e4f32523494484905d6751ef6323', 'request_id': 'req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.369841 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0554efd-4107-4150-8421-78a11fc16630 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:14.372070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e0554efd-4107-4150-8421-78a11fc16630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:14.390527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] The token cache is being invalidate because project d350e4f32523494484905d6751ef6323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:14.391386 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.392000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.398005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 966/1920] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:14 2022] DELETE /identity/v3/projects/d350e4f32523494484905d6751ef6323 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:14.402835 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:14.407398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:14.407973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0554efd-4107-4150-8421-78a11fc16630 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:14.468389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:14.549135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aedc1b-b5bf-4524-9cd2-ea40d88032a6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:14.563720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:14.564395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:14.564850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:14.565395 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] PATH_INFO: `/v3/users/9e22254379be4a4782765dd918ea6afd` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:14.566898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e22254379be4a4782765dd918ea6afd)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:14.572232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:14.579898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:14.581106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:14.581567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:14.582134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] PATH_INFO: `/v3/projects/251ed40681da420eb17ed4d223b83d7d` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:14.583809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=251ed40681da420eb17ed4d223b83d7d)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:14.586385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:14.678598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e22254379be4a4782765dd918ea6afd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.698894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e22254379be4a4782765dd918ea6afd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.703108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e22254379be4a4782765dd918ea6afd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.704263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e22254379be4a4782765dd918ea6afd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.714358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251ed40681da420eb17ed4d223b83d7d', 'request_id': 'req-f0b12dea-657d-4b83-a34e-ae2d422937fe'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.717863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b8bc693a-51f8-4c08-8dbb-b09e0ba95b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e22254379be4a4782765dd918ea6afd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.720742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251ed40681da420eb17ed4d223b83d7d', 'request_id': 'req-f0b12dea-657d-4b83-a34e-ae2d422937fe'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.734662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251ed40681da420eb17ed4d223b83d7d', 'request_id': 'req-f0b12dea-657d-4b83-a34e-ae2d422937fe'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.744579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 967/1921] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:14 2022] DELETE /identity/v3/users/9e22254379be4a4782765dd918ea6afd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:14.749629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44db05b-581b-44c4-8210-0be67ffef93c None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:14.749915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44db05b-581b-44c4-8210-0be67ffef93c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:14.750185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44db05b-581b-44c4-8210-0be67ffef93c None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:14.752328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 968/1922] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:22:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:14.752968 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44db05b-581b-44c4-8210-0be67ffef93c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:14.755124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b44db05b-581b-44c4-8210-0be67ffef93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:14.757565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] The token cache is being invalidate because project 251ed40681da420eb17ed4d223b83d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:14.758130 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.759080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f0b12dea-657d-4b83-a34e-ae2d422937fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:14.761300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 955/1923] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:14 2022] DELETE /identity/v3/projects/251ed40681da420eb17ed4d223b83d7d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:14.766420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390fffe-5c83-42ba-a7d1-805d9bc4fc7c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:14.766707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390fffe-5c83-42ba-a7d1-805d9bc4fc7c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:14.767033 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390fffe-5c83-42ba-a7d1-805d9bc4fc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:14.795258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-2390fffe-5c83-42ba-a7d1-805d9bc4fc7c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:14.796618 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2390fffe-5c83-42ba-a7d1-805d9bc4fc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:14.839349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:14.893152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44db05b-581b-44c4-8210-0be67ffef93c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:14.900378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:14.901416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:14.902033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:14.903117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] PATH_INFO: `/v3/projects/74249db2f020427ab4815b6e293305a4` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:14.905013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74249db2f020427ab4815b6e293305a4)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:14.908152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:14.950467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 956/1924] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:14.951769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be88c6-d377-4444-9264-f5ccf76bad1c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:14.952042 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be88c6-d377-4444-9264-f5ccf76bad1c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:14.952313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be88c6-d377-4444-9264-f5ccf76bad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:14.995946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:14.998228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-19be88c6-d377-4444-9264-f5ccf76bad1c None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:15.000186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-19be88c6-d377-4444-9264-f5ccf76bad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:15.001255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74249db2f020427ab4815b6e293305a4', 'request_id': 'req-f8250648-175f-4f11-a474-724b1eab4ba1'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.010892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74249db2f020427ab4815b6e293305a4', 'request_id': 'req-f8250648-175f-4f11-a474-724b1eab4ba1'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.022459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74249db2f020427ab4815b6e293305a4', 'request_id': 'req-f8250648-175f-4f11-a474-724b1eab4ba1'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.082452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] The token cache is being invalidate because project 74249db2f020427ab4815b6e293305a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:15.082980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.086144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8250648-175f-4f11-a474-724b1eab4ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.089384 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 969/1925] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:14 2022] DELETE /identity/v3/projects/74249db2f020427ab4815b6e293305a4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:15.099733 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124988-ec2b-4a81-be21-abe538b36e50 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:15.100061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124988-ec2b-4a81-be21-abe538b36e50 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:15.100284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124988-ec2b-4a81-be21-abe538b36e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:15.152242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 957/1926] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:22:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:15.154197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be88c6-d377-4444-9264-f5ccf76bad1c None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:15.173772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-19be88c6-d377-4444-9264-f5ccf76bad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:15.177596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-79124988-ec2b-4a81-be21-abe538b36e50 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:15.181040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-79124988-ec2b-4a81-be21-abe538b36e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:15.282195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be88c6-d377-4444-9264-f5ccf76bad1c None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:15.289423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:15.290255 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:15.290592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:15.291189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] PATH_INFO: `/v3/users/1729e165ee654162b46b3a245c4e47fd` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:15.292935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1729e165ee654162b46b3a245c4e47fd)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:15.295730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:15.307355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 970/1927] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:15.313667 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79124988-ec2b-4a81-be21-abe538b36e50 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:15.325228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79124988-ec2b-4a81-be21-abe538b36e50 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:15.334127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc768ed-5822-4df2-a712-b56b2ecb9138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:15.335901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc768ed-5822-4df2-a712-b56b2ecb9138 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:15.336405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc768ed-5822-4df2-a712-b56b2ecb9138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:15.337035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc768ed-5822-4df2-a712-b56b2ecb9138 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:15.350884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc768ed-5822-4df2-a712-b56b2ecb9138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:15.354644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc768ed-5822-4df2-a712-b56b2ecb9138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:15.359042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc768ed-5822-4df2-a712-b56b2ecb9138 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:15.384127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1729e165ee654162b46b3a245c4e47fd'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.394188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 971/1928] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:15.398131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc768ed-5822-4df2-a712-b56b2ecb9138 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:15.404221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8fc768ed-5822-4df2-a712-b56b2ecb9138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:15.412217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1729e165ee654162b46b3a245c4e47fd'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.413338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1729e165ee654162b46b3a245c4e47fd'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.415070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1729e165ee654162b46b3a245c4e47fd'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.423349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1729e165ee654162b46b3a245c4e47fd'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.426096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:15.443893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc768ed-5822-4df2-a712-b56b2ecb9138 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:15.451632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 958/1929] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:15 2022] DELETE /identity/v3/users/1729e165ee654162b46b3a245c4e47fd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:15.452774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de6a6-26db-43ee-83ee-9c52f0da6a73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:15.452916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:15.453866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de6a6-26db-43ee-83ee-9c52f0da6a73 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:15.454341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de6a6-26db-43ee-83ee-9c52f0da6a73 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:15.455883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de6a6-26db-43ee-83ee-9c52f0da6a73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:15.458377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4b8de6a6-26db-43ee-83ee-9c52f0da6a73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:15.464844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:15.481273 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de6a6-26db-43ee-83ee-9c52f0da6a73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:15.483982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de6a6-26db-43ee-83ee-9c52f0da6a73 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:15.499031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 972/1930] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:15.519006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de6a6-26db-43ee-83ee-9c52f0da6a73 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:15.522585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4b8de6a6-26db-43ee-83ee-9c52f0da6a73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:15.562154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de6a6-26db-43ee-83ee-9c52f0da6a73 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:15.684380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd10ca8-64e4-4dad-b9a2-7f63cb4b640a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:15.693847 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:15.695068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:15.695217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af665cf-b30f-41c0-b077-1595ee9d23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:15.695949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:15.696084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af665cf-b30f-41c0-b077-1595ee9d23d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:15.696319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] PATH_INFO: `/v3/projects/03eef5691dcf4e7f86a7288d316370b3` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:15.696424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af665cf-b30f-41c0-b077-1595ee9d23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:15.696740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af665cf-b30f-41c0-b077-1595ee9d23d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:15.697413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af665cf-b30f-41c0-b077-1595ee9d23d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:15.698743 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=03eef5691dcf4e7f86a7288d316370b3)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:15.701989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:15.702302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af665cf-b30f-41c0-b077-1595ee9d23d5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:15.796200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 973/1931] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:15 2022] POST /identity/v3/projects => generated 365 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:15.797177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af665cf-b30f-41c0-b077-1595ee9d23d5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:15.803373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03eef5691dcf4e7f86a7288d316370b3', 'request_id': 'req-76cc5432-663f-42b3-9c02-e46c3057e1bc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.819019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03eef5691dcf4e7f86a7288d316370b3', 'request_id': 'req-76cc5432-663f-42b3-9c02-e46c3057e1bc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.851944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03eef5691dcf4e7f86a7288d316370b3', 'request_id': 'req-76cc5432-663f-42b3-9c02-e46c3057e1bc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.866929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:15.895718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] The token cache is being invalidate because project 03eef5691dcf4e7f86a7288d316370b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:15.896089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.896802 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-76cc5432-663f-42b3-9c02-e46c3057e1bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:15.898598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 959/1932] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:15 2022] DELETE /identity/v3/projects/03eef5691dcf4e7f86a7288d316370b3 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:15.905304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e710a7-b54a-457f-9f4e-9454df1cd193 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:15.906107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e710a7-b54a-457f-9f4e-9454df1cd193 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:15.906325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e710a7-b54a-457f-9f4e-9454df1cd193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:15.941087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-81e710a7-b54a-457f-9f4e-9454df1cd193 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:15.942589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-81e710a7-b54a-457f-9f4e-9454df1cd193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:15.957602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af665cf-b30f-41c0-b077-1595ee9d23d5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:15.958182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 960/1933] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:15.968493 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66525b1-f3a0-4d76-a3c3-d9c398220d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:15.969304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66525b1-f3a0-4d76-a3c3-d9c398220d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:15.971333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bc30a-c6bd-4b84-992f-2da0070ccd7a None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:15.971651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bc30a-c6bd-4b84-992f-2da0070ccd7a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:15.971929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bc30a-c6bd-4b84-992f-2da0070ccd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:15.972861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66525b1-f3a0-4d76-a3c3-d9c398220d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:15.973501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66525b1-f3a0-4d76-a3c3-d9c398220d41 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:15.975016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66525b1-f3a0-4d76-a3c3-d9c398220d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:15.978965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66525b1-f3a0-4d76-a3c3-d9c398220d41 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.006736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-810bc30a-c6bd-4b84-992f-2da0070ccd7a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:16.007954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-810bc30a-c6bd-4b84-992f-2da0070ccd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.022414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 974/1934] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:15 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:16.023961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 961/1935] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:16.029464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66525b1-f3a0-4d76-a3c3-d9c398220d41 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.029646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bc30a-c6bd-4b84-992f-2da0070ccd7a None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.031441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e66525b1-f3a0-4d76-a3c3-d9c398220d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.043169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bc30a-c6bd-4b84-992f-2da0070ccd7a None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.049187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c974-7c33-4288-a887-946d7e9e1d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.049969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c974-7c33-4288-a887-946d7e9e1d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.050295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c974-7c33-4288-a887-946d7e9e1d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.050426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66525b1-f3a0-4d76-a3c3-d9c398220d41 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.050868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c974-7c33-4288-a887-946d7e9e1d3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.051491 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85c974-7c33-4288-a887-946d7e9e1d3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:16.051771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85c974-7c33-4288-a887-946d7e9e1d3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.053687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85c974-7c33-4288-a887-946d7e9e1d3a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.056060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf96587-28e8-4d41-94ab-21a2b09c27fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.056846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf96587-28e8-4d41-94ab-21a2b09c27fa admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.057123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf96587-28e8-4d41-94ab-21a2b09c27fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.058139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf96587-28e8-4d41-94ab-21a2b09c27fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.058579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf96587-28e8-4d41-94ab-21a2b09c27fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.060346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf96587-28e8-4d41-94ab-21a2b09c27fa admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.072850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 962/1936] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:16.080340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c974-7c33-4288-a887-946d7e9e1d3a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.080541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 975/1937] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:16.085161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf96587-28e8-4d41-94ab-21a2b09c27fa admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.097525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c974-7c33-4288-a887-946d7e9e1d3a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.099897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf96587-28e8-4d41-94ab-21a2b09c27fa admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.102619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730fbc8-d458-4fb7-8a4b-3cc483b947a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.103392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730fbc8-d458-4fb7-8a4b-3cc483b947a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.103675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730fbc8-d458-4fb7-8a4b-3cc483b947a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.103958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730fbc8-d458-4fb7-8a4b-3cc483b947a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.104696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730fbc8-d458-4fb7-8a4b-3cc483b947a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.106797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730fbc8-d458-4fb7-8a4b-3cc483b947a9 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.124051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d112e71-eb2e-44bb-9769-65f9c600d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.125104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d112e71-eb2e-44bb-9769-65f9c600d14c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.127747 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d112e71-eb2e-44bb-9769-65f9c600d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.128033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d112e71-eb2e-44bb-9769-65f9c600d14c admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.128849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d112e71-eb2e-44bb-9769-65f9c600d14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.133143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d112e71-eb2e-44bb-9769-65f9c600d14c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.156817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 976/1938] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:16.160816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d112e71-eb2e-44bb-9769-65f9c600d14c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.173340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 963/1939] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:16 2022] POST /identity/v3/projects => generated 359 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:16.175542 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d112e71-eb2e-44bb-9769-65f9c600d14c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.177740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730fbc8-d458-4fb7-8a4b-3cc483b947a9 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.219336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:16.246584 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6074736-202f-4768-a15c-ad93c58423bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.257519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6074736-202f-4768-a15c-ad93c58423bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.257519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6074736-202f-4768-a15c-ad93c58423bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.257892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6074736-202f-4768-a15c-ad93c58423bd admin admin] PATH_INFO: `/v3/projects/8b1d3dee96b24ea1acae3aec4cc0af43/users/7fc365298e234e74ab304845a76bf61f/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.280570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730fbc8-d458-4fb7-8a4b-3cc483b947a9 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.285541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6074736-202f-4768-a15c-ad93c58423bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1d3dee96b24ea1acae3aec4cc0af43, user_id=7fc365298e234e74ab304845a76bf61f, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.285663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95469f6b-1293-479d-945c-a0adbd29e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.286419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469f6b-1293-479d-945c-a0adbd29e54a admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.286571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469f6b-1293-479d-945c-a0adbd29e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.286818 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469f6b-1293-479d-945c-a0adbd29e54a admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.287441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95469f6b-1293-479d-945c-a0adbd29e54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.288751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6074736-202f-4768-a15c-ad93c58423bd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.289411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95469f6b-1293-479d-945c-a0adbd29e54a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.303208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 977/1940] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:16 2022] PUT /identity/v3/projects/8b1d3dee96b24ea1acae3aec4cc0af43/users/7fc365298e234e74ab304845a76bf61f/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:16.304273 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6074736-202f-4768-a15c-ad93c58423bd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.314211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c6074736-202f-4768-a15c-ad93c58423bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.314873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 964/1941] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:16 2022] POST /identity/v3/users => generated 280 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:16.316181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90de77-08af-4a4e-b449-43d2b1faf649 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.316532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90de77-08af-4a4e-b449-43d2b1faf649 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.316894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90de77-08af-4a4e-b449-43d2b1faf649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.345697 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5a90de77-08af-4a4e-b449-43d2b1faf649 None None] MFA Rules not processed for user `7fc365298e234e74ab304845a76bf61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:16.346912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5a90de77-08af-4a4e-b449-43d2b1faf649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.384754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6074736-202f-4768-a15c-ad93c58423bd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.392074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.392914 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.393211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.393799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] PATH_INFO: `/v3/projects/8dff0239e4b64a2490c6d1b521923dc5` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.395173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dff0239e4b64a2490c6d1b521923dc5)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.424773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 965/1942] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:16.425527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.425886 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90de77-08af-4a4e-b449-43d2b1faf649 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.440663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90de77-08af-4a4e-b449-43d2b1faf649 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.445755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e41ec-3b9a-49e3-8ebd-a6b47206289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.446366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e41ec-3b9a-49e3-8ebd-a6b47206289d admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.446783 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e41ec-3b9a-49e3-8ebd-a6b47206289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.447058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e41ec-3b9a-49e3-8ebd-a6b47206289d admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.447843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e41ec-3b9a-49e3-8ebd-a6b47206289d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.450548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e41ec-3b9a-49e3-8ebd-a6b47206289d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.466705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 966/1943] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:16.466705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e41ec-3b9a-49e3-8ebd-a6b47206289d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.476707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e41ec-3b9a-49e3-8ebd-a6b47206289d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.480724 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:16.483821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0863f6a-db67-4fe6-ae25-68a30d7e089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.484466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863f6a-db67-4fe6-ae25-68a30d7e089c admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.484777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863f6a-db67-4fe6-ae25-68a30d7e089c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.485046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863f6a-db67-4fe6-ae25-68a30d7e089c admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.485814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0863f6a-db67-4fe6-ae25-68a30d7e089c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.488155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0863f6a-db67-4fe6-ae25-68a30d7e089c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.525609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dff0239e4b64a2490c6d1b521923dc5', 'request_id': 'req-df4835d2-c0aa-4350-b5a1-640bb8c4384d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:16.533738 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 967/1944] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:16 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:16.537845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0863f6a-db67-4fe6-ae25-68a30d7e089c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.540092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dff0239e4b64a2490c6d1b521923dc5', 'request_id': 'req-df4835d2-c0aa-4350-b5a1-640bb8c4384d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:16.553346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dff0239e4b64a2490c6d1b521923dc5', 'request_id': 'req-df4835d2-c0aa-4350-b5a1-640bb8c4384d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:16.571939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] The token cache is being invalidate because project 8dff0239e4b64a2490c6d1b521923dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:16.572376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:16.573977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:16.580751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 978/1945] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:16 2022] DELETE /identity/v3/projects/8dff0239e4b64a2490c6d1b521923dc5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:16.580751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.580751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.628917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0863f6a-db67-4fe6-ae25-68a30d7e089c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.634007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5bfce-4119-4624-aeb3-bd38650e5671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.634598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5bfce-4119-4624-aeb3-bd38650e5671 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.634872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5bfce-4119-4624-aeb3-bd38650e5671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.635139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5bfce-4119-4624-aeb3-bd38650e5671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.635841 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5bfce-4119-4624-aeb3-bd38650e5671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.637523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5bfce-4119-4624-aeb3-bd38650e5671 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.648148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 968/1946] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:16.654303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e1d36-d550-45da-91c7-c8139d2f0b91 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.654590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e1d36-d550-45da-91c7-c8139d2f0b91 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.654861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e1d36-d550-45da-91c7-c8139d2f0b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.671315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4835d2-c0aa-4350-b5a1-640bb8c4384d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.672868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:16.682287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-635e1d36-d550-45da-91c7-c8139d2f0b91 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:16.686831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-635e1d36-d550-45da-91c7-c8139d2f0b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.690324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e5907-38c3-48dd-be00-129abc9c9606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.691425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e5907-38c3-48dd-be00-129abc9c9606 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.692197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e5907-38c3-48dd-be00-129abc9c9606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.692478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e5907-38c3-48dd-be00-129abc9c9606 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.693474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e5907-38c3-48dd-be00-129abc9c9606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.695551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e5907-38c3-48dd-be00-129abc9c9606 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.716251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 969/1947] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:16.717066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e1d36-d550-45da-91c7-c8139d2f0b91 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.718401 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-635e1d36-d550-45da-91c7-c8139d2f0b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.726532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 979/1948] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:16 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:16.728510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d170-ae98-48ec-9694-da2262b50473 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.728986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d170-ae98-48ec-9694-da2262b50473 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.730019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7d170-ae98-48ec-9694-da2262b50473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.732444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e1d36-d550-45da-91c7-c8139d2f0b91 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.740596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6271c7-e5a9-4a42-9406-c4b7cedcc68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.741666 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6271c7-e5a9-4a42-9406-c4b7cedcc68e admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.741809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6271c7-e5a9-4a42-9406-c4b7cedcc68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.742115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6271c7-e5a9-4a42-9406-c4b7cedcc68e admin admin] PATH_INFO: `/v3/projects/768db0593a304569a63763d6c7bd072c/users/887444b9e2224f43b6b7a4bde0ff9742/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.753971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b4a7d170-ae98-48ec-9694-da2262b50473 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:16.755427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b4a7d170-ae98-48ec-9694-da2262b50473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.767994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6271c7-e5a9-4a42-9406-c4b7cedcc68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=768db0593a304569a63763d6c7bd072c, user_id=887444b9e2224f43b6b7a4bde0ff9742, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.770611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6271c7-e5a9-4a42-9406-c4b7cedcc68e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.771827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 980/1949] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:16.775560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7d170-ae98-48ec-9694-da2262b50473 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.786126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7d170-ae98-48ec-9694-da2262b50473 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.789910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 970/1950] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:16 2022] PUT /identity/v3/projects/768db0593a304569a63763d6c7bd072c/users/887444b9e2224f43b6b7a4bde0ff9742/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:16.799861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6271c7-e5a9-4a42-9406-c4b7cedcc68e admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.876174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f908d88-52b0-4916-97ec-f3f36694cfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.877468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908d88-52b0-4916-97ec-f3f36694cfab admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.877863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908d88-52b0-4916-97ec-f3f36694cfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.879115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908d88-52b0-4916-97ec-f3f36694cfab admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.879855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f908d88-52b0-4916-97ec-f3f36694cfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.882023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f908d88-52b0-4916-97ec-f3f36694cfab admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.883483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6271c7-e5a9-4a42-9406-c4b7cedcc68e admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.889795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fb72f-9262-4f57-81ce-0eaa22fcdbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.890647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fb72f-9262-4f57-81ce-0eaa22fcdbbe admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.891066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fb72f-9262-4f57-81ce-0eaa22fcdbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.891492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fb72f-9262-4f57-81ce-0eaa22fcdbbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.892377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fb72f-9262-4f57-81ce-0eaa22fcdbbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:16.892849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fb72f-9262-4f57-81ce-0eaa22fcdbbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.894949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fb72f-9262-4f57-81ce-0eaa22fcdbbe admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.906674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 981/1951] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:16.907814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9f7d9-0842-4bf0-90ab-1bde81eba83d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.908128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9f7d9-0842-4bf0-90ab-1bde81eba83d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.908464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9f7d9-0842-4bf0-90ab-1bde81eba83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.913731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 971/1952] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:16.914636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fb72f-9262-4f57-81ce-0eaa22fcdbbe admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.927462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fb72f-9262-4f57-81ce-0eaa22fcdbbe admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.938128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8949f-9fd3-4c36-a920-4d52c943f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.939438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8949f-9fd3-4c36-a920-4d52c943f7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.939438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8949f-9fd3-4c36-a920-4d52c943f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.939438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8949f-9fd3-4c36-a920-4d52c943f7f2 admin admin] PATH_INFO: `/v3/projects/7ac302db0de34d1f8936ff3090cbef08/users/d4e4f2f7e91041deb6992d75fb599d50/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.958346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f9c9f7d9-0842-4bf0-90ab-1bde81eba83d None None] MFA Rules not processed for user `887444b9e2224f43b6b7a4bde0ff9742`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:16.959695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f9c9f7d9-0842-4bf0-90ab-1bde81eba83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.963533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8949f-9fd3-4c36-a920-4d52c943f7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac302db0de34d1f8936ff3090cbef08, user_id=d4e4f2f7e91041deb6992d75fb599d50, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.967451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8949f-9fd3-4c36-a920-4d52c943f7f2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.984176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:16.991058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 972/1953] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:16 2022] PUT /identity/v3/projects/7ac302db0de34d1f8936ff3090cbef08/users/d4e4f2f7e91041deb6992d75fb599d50/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:16.991058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8949f-9fd3-4c36-a920-4d52c943f7f2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.064333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 982/1954] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:17.065096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9f7d9-0842-4bf0-90ab-1bde81eba83d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.066413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f9c9f7d9-0842-4bf0-90ab-1bde81eba83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.085814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9f7d9-0842-4bf0-90ab-1bde81eba83d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.116647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8949f-9fd3-4c36-a920-4d52c943f7f2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.119159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5767a9-03dc-4218-836b-67f5b762fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.120031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5767a9-03dc-4218-836b-67f5b762fa38 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.120828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5767a9-03dc-4218-836b-67f5b762fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.121226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5767a9-03dc-4218-836b-67f5b762fa38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.121935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5767a9-03dc-4218-836b-67f5b762fa38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.123873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5767a9-03dc-4218-836b-67f5b762fa38 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.154097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 973/1955] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:16 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:17.155335 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5767a9-03dc-4218-836b-67f5b762fa38 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.164700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.165226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.165499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.165837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] PATH_INFO: `/v3/users/9f3567e8f4644b97b71523d88a7d6b51` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.166938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3567e8f4644b97b71523d88a7d6b51)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.169046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.194676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:17.229079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3567e8f4644b97b71523d88a7d6b51'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.236659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5767a9-03dc-4218-836b-67f5b762fa38 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.239407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3567e8f4644b97b71523d88a7d6b51'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.240115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3567e8f4644b97b71523d88a7d6b51'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.240792 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3567e8f4644b97b71523d88a7d6b51'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.242386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902c04f-7389-401f-8b6b-c974eaf92ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.243241 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902c04f-7389-401f-8b6b-c974eaf92ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.243730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902c04f-7389-401f-8b6b-c974eaf92ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.244074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902c04f-7389-401f-8b6b-c974eaf92ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.244869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902c04f-7389-401f-8b6b-c974eaf92ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.247070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902c04f-7389-401f-8b6b-c974eaf92ff3 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.250231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3567e8f4644b97b71523d88a7d6b51'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.267404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 974/1956] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:17.267404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902c04f-7389-401f-8b6b-c974eaf92ff3 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.271927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1902c04f-7389-401f-8b6b-c974eaf92ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.274451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 983/1957] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:17 2022] DELETE /identity/v3/users/9f3567e8f4644b97b71523d88a7d6b51 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:17.275122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.279975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.334797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:17.359395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902c04f-7389-401f-8b6b-c974eaf92ff3 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.365698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b49b5-169d-43db-9493-f1d3426679cb admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.371269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaea45-1bbf-4a01-80c2-b47ab35d3ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.371884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaea45-1bbf-4a01-80c2-b47ab35d3ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.372153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaea45-1bbf-4a01-80c2-b47ab35d3ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.372426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaea45-1bbf-4a01-80c2-b47ab35d3ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.373082 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaea45-1bbf-4a01-80c2-b47ab35d3ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.375018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaea45-1bbf-4a01-80c2-b47ab35d3ae3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.408667 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 984/1958] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:17 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:17.408667 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaea45-1bbf-4a01-80c2-b47ab35d3ae3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.409064 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b4aaea45-1bbf-4a01-80c2-b47ab35d3ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.422949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaea45-1bbf-4a01-80c2-b47ab35d3ae3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.424842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4911b49-712a-40bc-8b15-f02fe042571c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.425509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4911b49-712a-40bc-8b15-f02fe042571c service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.426007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4911b49-712a-40bc-8b15-f02fe042571c service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.426300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4911b49-712a-40bc-8b15-f02fe042571c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.428335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a638330-4c12-4a56-b494-1cd6a1b31c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.429034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a638330-4c12-4a56-b494-1cd6a1b31c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.429357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a638330-4c12-4a56-b494-1cd6a1b31c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.429626 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a638330-4c12-4a56-b494-1cd6a1b31c91 admin admin] PATH_INFO: `/v3/projects/7ac302db0de34d1f8936ff3090cbef08/users/d4e4f2f7e91041deb6992d75fb599d50/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.430347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d4911b49-712a-40bc-8b15-f02fe042571c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.431622 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a638330-4c12-4a56-b494-1cd6a1b31c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac302db0de34d1f8936ff3090cbef08, user_id=d4e4f2f7e91041deb6992d75fb599d50, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.435601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a638330-4c12-4a56-b494-1cd6a1b31c91 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.446787 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 985/1959] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:17 2022] PUT /identity/v3/projects/7ac302db0de34d1f8936ff3090cbef08/users/d4e4f2f7e91041deb6992d75fb599d50/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:17.448096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dde61-c226-4381-bf63-171cad016e40 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.449264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dde61-c226-4381-bf63-171cad016e40 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.449734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dde61-c226-4381-bf63-171cad016e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.470897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-be8dde61-c226-4381-bf63-171cad016e40 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:17.472310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-be8dde61-c226-4381-bf63-171cad016e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.500354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4911b49-712a-40bc-8b15-f02fe042571c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.501839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4911b49-712a-40bc-8b15-f02fe042571c service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.512238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 975/1960] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:17.513195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4911b49-712a-40bc-8b15-f02fe042571c service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.531678 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4911b49-712a-40bc-8b15-f02fe042571c service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.548830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 986/1961] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:17.548830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c142e34-bf82-4007-a9f8-cf9db642d9ef None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.548830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c142e34-bf82-4007-a9f8-cf9db642d9ef None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.548830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c142e34-bf82-4007-a9f8-cf9db642d9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.570005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:17.579305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2c142e34-bf82-4007-a9f8-cf9db642d9ef None None] MFA Rules not processed for user `d4e4f2f7e91041deb6992d75fb599d50`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:17.580514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2c142e34-bf82-4007-a9f8-cf9db642d9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.595374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b9747-a467-4f23-aa2f-ed021314ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.595978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b9747-a467-4f23-aa2f-ed021314ad6c admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.596251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b9747-a467-4f23-aa2f-ed021314ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.596512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b9747-a467-4f23-aa2f-ed021314ad6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.597156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b9747-a467-4f23-aa2f-ed021314ad6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.598760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b9747-a467-4f23-aa2f-ed021314ad6c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.609409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 976/1962] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:17.610223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b9747-a467-4f23-aa2f-ed021314ad6c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.612270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-261b9747-a467-4f23-aa2f-ed021314ad6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.625290 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b9747-a467-4f23-aa2f-ed021314ad6c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.630652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.631269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.631573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.631839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] PATH_INFO: `/v3/users/887444b9e2224f43b6b7a4bde0ff9742` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.632991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=887444b9e2224f43b6b7a4bde0ff9742)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.634895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.664116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 987/1963] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:17.668805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c142e34-bf82-4007-a9f8-cf9db642d9ef None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.668805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2c142e34-bf82-4007-a9f8-cf9db642d9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.695933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887444b9e2224f43b6b7a4bde0ff9742'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.716558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887444b9e2224f43b6b7a4bde0ff9742'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.718509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887444b9e2224f43b6b7a4bde0ff9742'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.718509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887444b9e2224f43b6b7a4bde0ff9742'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.719596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:17.734360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c142e34-bf82-4007-a9f8-cf9db642d9ef None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.738494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52513b3a-ce6c-42d8-9386-6c8f0fc20550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.739195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52513b3a-ce6c-42d8-9386-6c8f0fc20550 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.739541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52513b3a-ce6c-42d8-9386-6c8f0fc20550 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.739878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52513b3a-ce6c-42d8-9386-6c8f0fc20550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.741694 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887444b9e2224f43b6b7a4bde0ff9742'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.741817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-52513b3a-ce6c-42d8-9386-6c8f0fc20550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.756334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52513b3a-ce6c-42d8-9386-6c8f0fc20550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.758102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52513b3a-ce6c-42d8-9386-6c8f0fc20550 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.769360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 988/1964] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:17.770360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52513b3a-ce6c-42d8-9386-6c8f0fc20550 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.771800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-52513b3a-ce6c-42d8-9386-6c8f0fc20550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.784085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52513b3a-ce6c-42d8-9386-6c8f0fc20550 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.789756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84c03c-a9f7-4919-be16-f056ed5e8c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.790624 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84c03c-a9f7-4919-be16-f056ed5e8c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.790994 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84c03c-a9f7-4919-be16-f056ed5e8c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.792288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84c03c-a9f7-4919-be16-f056ed5e8c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.793049 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84c03c-a9f7-4919-be16-f056ed5e8c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.795062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84c03c-a9f7-4919-be16-f056ed5e8c4d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.803545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 977/1965] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:17 2022] DELETE /identity/v3/users/887444b9e2224f43b6b7a4bde0ff9742 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:17.804753 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.807610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.813693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 989/1966] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:17.816208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d14af-1744-4540-a87d-bd654315b739 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.816499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d14af-1744-4540-a87d-bd654315b739 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.816805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d14af-1744-4540-a87d-bd654315b739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.849101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-274d14af-1744-4540-a87d-bd654315b739 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:17.850744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-274d14af-1744-4540-a87d-bd654315b739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.934823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532300dd-9c67-4560-b51c-21296ec85c6c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.935696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 990/1967] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:17.937065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d14af-1744-4540-a87d-bd654315b739 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.943060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef62712-b4fe-47de-8393-c2969850cac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.944369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62712-b4fe-47de-8393-c2969850cac2 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.944919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62712-b4fe-47de-8393-c2969850cac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.945427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62712-b4fe-47de-8393-c2969850cac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.954265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-7ef62712-b4fe-47de-8393-c2969850cac2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.961564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d14af-1744-4540-a87d-bd654315b739 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.972319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65252ff-2b9e-4b20-b779-4702283098e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.974243 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65252ff-2b9e-4b20-b779-4702283098e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.974558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65252ff-2b9e-4b20-b779-4702283098e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.974834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65252ff-2b9e-4b20-b779-4702283098e2 admin admin] PATH_INFO: `/v3/projects/714e70d902f0499ca61d42ca3281d64c/users/f6018b56ae824ac6a251d1b50f6b9f8c/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.000060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65252ff-2b9e-4b20-b779-4702283098e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714e70d902f0499ca61d42ca3281d64c, user_id=f6018b56ae824ac6a251d1b50f6b9f8c, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.003136 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65252ff-2b9e-4b20-b779-4702283098e2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.025092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 991/1968] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:17 2022] PUT /identity/v3/projects/714e70d902f0499ca61d42ca3281d64c/users/f6018b56ae824ac6a251d1b50f6b9f8c/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:18.026525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65252ff-2b9e-4b20-b779-4702283098e2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.036659 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c65252ff-2b9e-4b20-b779-4702283098e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:18.088172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:18.093762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef62712-b4fe-47de-8393-c2969850cac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.095389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef62712-b4fe-47de-8393-c2969850cac2 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.108291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 978/1969] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:18.118065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2b4a-bb8d-4791-bbb4-15624a038cc8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.118374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2b4a-bb8d-4791-bbb4-15624a038cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.118653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2b4a-bb8d-4791-bbb4-15624a038cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.177247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-80dc2b4a-bb8d-4791-bbb4-15624a038cc8 None None] MFA Rules not processed for user `f6018b56ae824ac6a251d1b50f6b9f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:18.178600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-80dc2b4a-bb8d-4791-bbb4-15624a038cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:18.195055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65252ff-2b9e-4b20-b779-4702283098e2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.211669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2108ae4-cf22-4091-ab2c-1d008369550b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.212372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2108ae4-cf22-4091-ab2c-1d008369550b service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.212686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2108ae4-cf22-4091-ab2c-1d008369550b service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.212962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2108ae4-cf22-4091-ab2c-1d008369550b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.263501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 979/1970] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:18.265523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc2b4a-bb8d-4791-bbb4-15624a038cc8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.320505 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2108ae4-cf22-4091-ab2c-1d008369550b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.322744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2108ae4-cf22-4091-ab2c-1d008369550b service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.339236 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:18.350583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 992/1971] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:18.351518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2108ae4-cf22-4091-ab2c-1d008369550b service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.364770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2108ae4-cf22-4091-ab2c-1d008369550b service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.370661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a6f74-0ccf-4774-8f86-abd74fd2ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.371392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a6f74-0ccf-4774-8f86-abd74fd2ac51 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.371848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a6f74-0ccf-4774-8f86-abd74fd2ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.372216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a6f74-0ccf-4774-8f86-abd74fd2ac51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.373005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a6f74-0ccf-4774-8f86-abd74fd2ac51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.375378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a6f74-0ccf-4774-8f86-abd74fd2ac51 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.431593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc2b4a-bb8d-4791-bbb4-15624a038cc8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.445244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498583-efa1-4675-ac35-7faad818cd81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.447858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498583-efa1-4675-ac35-7faad818cd81 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.449799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498583-efa1-4675-ac35-7faad818cd81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.450420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498583-efa1-4675-ac35-7faad818cd81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.458944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c0498583-efa1-4675-ac35-7faad818cd81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:18.462105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 993/1972] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:18 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:18.464390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a6f74-0ccf-4774-8f86-abd74fd2ac51 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.467421 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-815a6f74-0ccf-4774-8f86-abd74fd2ac51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:18.584433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0498583-efa1-4675-ac35-7faad818cd81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.586373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0498583-efa1-4675-ac35-7faad818cd81 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.594564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a6f74-0ccf-4774-8f86-abd74fd2ac51 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.599866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 980/1973] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:18.601006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498583-efa1-4675-ac35-7faad818cd81 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.614246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498583-efa1-4675-ac35-7faad818cd81 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.620291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109f38d-8a2a-4fb9-833e-9d0417166dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.620583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109f38d-8a2a-4fb9-833e-9d0417166dae admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.621145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109f38d-8a2a-4fb9-833e-9d0417166dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.621239 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109f38d-8a2a-4fb9-833e-9d0417166dae admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.622128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109f38d-8a2a-4fb9-833e-9d0417166dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.623035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.625103 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109f38d-8a2a-4fb9-833e-9d0417166dae admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.625982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.626741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.627276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] PATH_INFO: `/v3/projects/4ec2ef0358474f989dc5600cd420432e` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.630768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec2ef0358474f989dc5600cd420432e)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.638637 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.667254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 981/1974] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:18 2022] POST /identity/v3/users => generated 297 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:18.668185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109f38d-8a2a-4fb9-833e-9d0417166dae admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.683025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109f38d-8a2a-4fb9-833e-9d0417166dae admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.688754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228de90-1e22-4019-9a68-49b640a32d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.689345 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228de90-1e22-4019-9a68-49b640a32d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.689712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228de90-1e22-4019-9a68-49b640a32d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.689986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228de90-1e22-4019-9a68-49b640a32d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.690640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228de90-1e22-4019-9a68-49b640a32d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.692296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228de90-1e22-4019-9a68-49b640a32d44 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.708392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 982/1975] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:18.709301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228de90-1e22-4019-9a68-49b640a32d44 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.729034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228de90-1e22-4019-9a68-49b640a32d44 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.747373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:18.754169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec2ef0358474f989dc5600cd420432e', 'request_id': 'req-e3405458-20ee-4365-9603-49882be99e6d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:18.769389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec2ef0358474f989dc5600cd420432e', 'request_id': 'req-e3405458-20ee-4365-9603-49882be99e6d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:18.782361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec2ef0358474f989dc5600cd420432e', 'request_id': 'req-e3405458-20ee-4365-9603-49882be99e6d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:18.798473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] The token cache is being invalidate because project 4ec2ef0358474f989dc5600cd420432e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:18.799011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:18.799699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:18.801995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 994/1976] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:18 2022] DELETE /identity/v3/projects/4ec2ef0358474f989dc5600cd420432e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:18.806347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.826535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:18.884032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578ad4b-6415-4ab1-a799-76bb9573862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.884831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578ad4b-6415-4ab1-a799-76bb9573862b admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.885211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578ad4b-6415-4ab1-a799-76bb9573862b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.886119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578ad4b-6415-4ab1-a799-76bb9573862b admin admin] PATH_INFO: `/v3/projects/c8dba10dfc144dfc91b919e9fe9d5ae8/users/a6d301265fa34744addb4696e870bb8a/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.906112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578ad4b-6415-4ab1-a799-76bb9573862b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dba10dfc144dfc91b919e9fe9d5ae8, user_id=a6d301265fa34744addb4696e870bb8a, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.910104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578ad4b-6415-4ab1-a799-76bb9573862b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.940725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 983/1977] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:18 2022] PUT /identity/v3/projects/c8dba10dfc144dfc91b919e9fe9d5ae8/users/a6d301265fa34744addb4696e870bb8a/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:18.942441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578ad4b-6415-4ab1-a799-76bb9573862b admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.944329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5578ad4b-6415-4ab1-a799-76bb9573862b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:18.956942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3405458-20ee-4365-9603-49882be99e6d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.978599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:19.036960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578ad4b-6415-4ab1-a799-76bb9573862b admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:19.043119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c8a4-36b9-4efc-879d-0e290fc95028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:19.043705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c8a4-36b9-4efc-879d-0e290fc95028 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.044129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c8a4-36b9-4efc-879d-0e290fc95028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.044403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c8a4-36b9-4efc-879d-0e290fc95028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.045480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c8a4-36b9-4efc-879d-0e290fc95028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:19.047258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c8a4-36b9-4efc-879d-0e290fc95028 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:19.063297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 984/1978] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:19.064502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c8a4-36b9-4efc-879d-0e290fc95028 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:19.066031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:19.066739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.066928 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.067191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] PATH_INFO: `/v3/users/c45c816a0d644ecea7706cba75287e4a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.067474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-efe0c8a4-36b9-4efc-879d-0e290fc95028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.068575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45c816a0d644ecea7706cba75287e4a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:19.072066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:19.086852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c8a4-36b9-4efc-879d-0e290fc95028 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:19.092650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:19.101090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.105707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.106684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] PATH_INFO: `/v3/projects/768db0593a304569a63763d6c7bd072c` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.117884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] RBAC: Authorizing `identity:delete_project(project_id=768db0593a304569a63763d6c7bd072c)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:19.120059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:19.179969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45c816a0d644ecea7706cba75287e4a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.189217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45c816a0d644ecea7706cba75287e4a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.190244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45c816a0d644ecea7706cba75287e4a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.190787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768db0593a304569a63763d6c7bd072c', 'request_id': 'req-1a5daf4b-23bf-4447-aee9-af3f7957129a'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.190907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45c816a0d644ecea7706cba75287e4a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.199354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768db0593a304569a63763d6c7bd072c', 'request_id': 'req-1a5daf4b-23bf-4447-aee9-af3f7957129a'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.200713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45c816a0d644ecea7706cba75287e4a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.209601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768db0593a304569a63763d6c7bd072c', 'request_id': 'req-1a5daf4b-23bf-4447-aee9-af3f7957129a'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.227620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] The token cache is being invalidate because project 768db0593a304569a63763d6c7bd072c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:19.228299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.229451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1a5daf4b-23bf-4447-aee9-af3f7957129a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.231671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 995/1980] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:18 2022] DELETE /identity/v3/users/c45c816a0d644ecea7706cba75287e4a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:19.231839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 985/1980] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:19 2022] DELETE /identity/v3/projects/768db0593a304569a63763d6c7bd072c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:19.236056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:19.237528 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.253097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f511d2-d359-4c67-97b5-331f7e2d94ac None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.253361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f511d2-d359-4c67-97b5-331f7e2d94ac None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.253630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f511d2-d359-4c67-97b5-331f7e2d94ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.290183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-25f511d2-d359-4c67-97b5-331f7e2d94ac None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:19.292552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-25f511d2-d359-4c67-97b5-331f7e2d94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.303838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:19.364463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f506101-33ee-4745-88e3-c75af279d103 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:19.377656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59411f2f-dcad-4e6e-96e2-ee314541d707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:19.378975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59411f2f-dcad-4e6e-96e2-ee314541d707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.378975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59411f2f-dcad-4e6e-96e2-ee314541d707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.379199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59411f2f-dcad-4e6e-96e2-ee314541d707 admin admin] PATH_INFO: `/v3/projects/c8dba10dfc144dfc91b919e9fe9d5ae8/users/a6d301265fa34744addb4696e870bb8a/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.381505 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59411f2f-dcad-4e6e-96e2-ee314541d707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dba10dfc144dfc91b919e9fe9d5ae8, user_id=a6d301265fa34744addb4696e870bb8a, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:19.385047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59411f2f-dcad-4e6e-96e2-ee314541d707 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:19.399636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 986/1981] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:19.409964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df470a22-aadd-4ec0-8532-4e9399ac4da7 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.410498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df470a22-aadd-4ec0-8532-4e9399ac4da7 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.410876 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df470a22-aadd-4ec0-8532-4e9399ac4da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.412129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 996/1982] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:19 2022] PUT /identity/v3/projects/c8dba10dfc144dfc91b919e9fe9d5ae8/users/a6d301265fa34744addb4696e870bb8a/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:19.423955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf0714-11a6-469d-a20f-857517b70d67 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.424239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf0714-11a6-469d-a20f-857517b70d67 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.424518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf0714-11a6-469d-a20f-857517b70d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.449875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-df470a22-aadd-4ec0-8532-4e9399ac4da7 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:19.451725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-df470a22-aadd-4ec0-8532-4e9399ac4da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.468218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d4bf0714-11a6-469d-a20f-857517b70d67 None None] MFA Rules not processed for user `a6d301265fa34744addb4696e870bb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:19.469481 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d4bf0714-11a6-469d-a20f-857517b70d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.494180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:19.538142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 987/1983] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:19.542750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df470a22-aadd-4ec0-8532-4e9399ac4da7 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:19.553311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df470a22-aadd-4ec0-8532-4e9399ac4da7 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:19.561035 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8578ec-6083-48ec-8836-54601bb44800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:19.562208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8578ec-6083-48ec-8836-54601bb44800 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.562542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8578ec-6083-48ec-8836-54601bb44800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.563255 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8578ec-6083-48ec-8836-54601bb44800 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.563982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8578ec-6083-48ec-8836-54601bb44800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:19.564499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8578ec-6083-48ec-8836-54601bb44800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:19.566446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8578ec-6083-48ec-8836-54601bb44800 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:19.580341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 988/1984] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:19.584969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8578ec-6083-48ec-8836-54601bb44800 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:19.598678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 997/1985] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:19.607834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8578ec-6083-48ec-8836-54601bb44800 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:19.609901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf0714-11a6-469d-a20f-857517b70d67 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:19.611340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d4bf0714-11a6-469d-a20f-857517b70d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.613577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5a1a1-06f7-4233-86ac-343a5eeb3671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:19.614208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5a1a1-06f7-4233-86ac-343a5eeb3671 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.614519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5a1a1-06f7-4233-86ac-343a5eeb3671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.614785 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5a1a1-06f7-4233-86ac-343a5eeb3671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.615419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5a1a1-06f7-4233-86ac-343a5eeb3671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:19.617493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5a1a1-06f7-4233-86ac-343a5eeb3671 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:19.653144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 989/1986] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:19 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:19.653144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5a1a1-06f7-4233-86ac-343a5eeb3671 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:19.654954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e9f5a1a1-06f7-4233-86ac-343a5eeb3671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.688508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf0714-11a6-469d-a20f-857517b70d67 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:19.722948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5a1a1-06f7-4233-86ac-343a5eeb3671 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:19.727892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:19.728524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.728832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.729157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] PATH_INFO: `/v3/projects/352b72ede59e41aa931c2fbccfccf0d8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.730703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] RBAC: Authorizing `identity:delete_project(project_id=352b72ede59e41aa931c2fbccfccf0d8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:19.733158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:19.740689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b3513-f98f-4f24-a767-05f7814156cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:19.741427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3513-f98f-4f24-a767-05f7814156cd service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.741803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3513-f98f-4f24-a767-05f7814156cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.742132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3513-f98f-4f24-a767-05f7814156cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.756866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:19.782976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352b72ede59e41aa931c2fbccfccf0d8', 'request_id': 'req-2369b7c6-d20b-4081-bb83-00d81ace717d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.788467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352b72ede59e41aa931c2fbccfccf0d8', 'request_id': 'req-2369b7c6-d20b-4081-bb83-00d81ace717d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.796265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352b72ede59e41aa931c2fbccfccf0d8', 'request_id': 'req-2369b7c6-d20b-4081-bb83-00d81ace717d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.805250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b3513-f98f-4f24-a767-05f7814156cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:19.806725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b3513-f98f-4f24-a767-05f7814156cd service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:19.808370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] The token cache is being invalidate because project 352b72ede59e41aa931c2fbccfccf0d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:19.808682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.809341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:19.810872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 990/1987] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:19 2022] DELETE /identity/v3/projects/352b72ede59e41aa931c2fbccfccf0d8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:19.814211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:19.814211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.817869 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 998/1988] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:19.819373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6052c84-50c5-4336-b768-c016b9e01fd9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.819810 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6052c84-50c5-4336-b768-c016b9e01fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.820131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6052c84-50c5-4336-b768-c016b9e01fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.840569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d6052c84-50c5-4336-b768-c016b9e01fd9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:19.841917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d6052c84-50c5-4336-b768-c016b9e01fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.856911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:19.898725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369b7c6-d20b-4081-bb83-00d81ace717d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:19.904444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c5879-0580-4503-b6a9-e9b4296b4f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:19.905202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c5879-0580-4503-b6a9-e9b4296b4f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.905675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c5879-0580-4503-b6a9-e9b4296b4f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.906044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c5879-0580-4503-b6a9-e9b4296b4f59 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.906772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c5879-0580-4503-b6a9-e9b4296b4f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:19.909376 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c5879-0580-4503-b6a9-e9b4296b4f59 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:19.927700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 999/1989] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:19.937860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6052c84-50c5-4336-b768-c016b9e01fd9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:19.939425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d6052c84-50c5-4336-b768-c016b9e01fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.946107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 991/1990] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:19 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:19.946107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389349c-87be-4fb2-b162-a58566b0479a None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:19.946107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389349c-87be-4fb2-b162-a58566b0479a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:19.946107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389349c-87be-4fb2-b162-a58566b0479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:19.976330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-b389349c-87be-4fb2-b162-a58566b0479a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:19.977647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b389349c-87be-4fb2-b162-a58566b0479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:19.991049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 992/1991] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:19.991049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389349c-87be-4fb2-b162-a58566b0479a None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.002922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389349c-87be-4fb2-b162-a58566b0479a None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.007780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0613f3-99e9-42b1-acf1-a20d7693c708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.008466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0613f3-99e9-42b1-acf1-a20d7693c708 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.008596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6052c84-50c5-4336-b768-c016b9e01fd9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.008824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0613f3-99e9-42b1-acf1-a20d7693c708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.009069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0613f3-99e9-42b1-acf1-a20d7693c708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.009771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0613f3-99e9-42b1-acf1-a20d7693c708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.012101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0613f3-99e9-42b1-acf1-a20d7693c708 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.014065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92dcda-ab61-4d92-a978-5a3fffe689db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.014845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92dcda-ab61-4d92-a978-5a3fffe689db service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.015303 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92dcda-ab61-4d92-a978-5a3fffe689db service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.015773 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92dcda-ab61-4d92-a978-5a3fffe689db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.018287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4b92dcda-ab61-4d92-a978-5a3fffe689db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:20.023545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 993/1992] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:20.024445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0613f3-99e9-42b1-acf1-a20d7693c708 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.039568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0613f3-99e9-42b1-acf1-a20d7693c708 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.046170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc0721-ef8f-4ea3-b295-6111c0f2fb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.046783 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0721-ef8f-4ea3-b295-6111c0f2fb1c admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.047059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0721-ef8f-4ea3-b295-6111c0f2fb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.047364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0721-ef8f-4ea3-b295-6111c0f2fb1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.047999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc0721-ef8f-4ea3-b295-6111c0f2fb1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:20.048391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc0721-ef8f-4ea3-b295-6111c0f2fb1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.050378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc0721-ef8f-4ea3-b295-6111c0f2fb1c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.066463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 994/1993] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:20.070790 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc0721-ef8f-4ea3-b295-6111c0f2fb1c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.084783 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc0721-ef8f-4ea3-b295-6111c0f2fb1c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.092332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2950cb8-9570-48c2-bde7-180aa7399c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.092991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950cb8-9570-48c2-bde7-180aa7399c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.093526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950cb8-9570-48c2-bde7-180aa7399c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.093626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950cb8-9570-48c2-bde7-180aa7399c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.094328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2950cb8-9570-48c2-bde7-180aa7399c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.096091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2950cb8-9570-48c2-bde7-180aa7399c20 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.107387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92dcda-ab61-4d92-a978-5a3fffe689db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.109087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92dcda-ab61-4d92-a978-5a3fffe689db service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.110536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 995/1994] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:20.111499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2950cb8-9570-48c2-bde7-180aa7399c20 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.125223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2950cb8-9570-48c2-bde7-180aa7399c20 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.134880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da16ed8-5d7a-4f0f-8dc2-0478f6e0f126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.136883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1000/1995] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:20.137522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da16ed8-5d7a-4f0f-8dc2-0478f6e0f126 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.138260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92dcda-ab61-4d92-a978-5a3fffe689db service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.138487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da16ed8-5d7a-4f0f-8dc2-0478f6e0f126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.139109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da16ed8-5d7a-4f0f-8dc2-0478f6e0f126 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.140240 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da16ed8-5d7a-4f0f-8dc2-0478f6e0f126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.144310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da16ed8-5d7a-4f0f-8dc2-0478f6e0f126 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.162023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92dcda-ab61-4d92-a978-5a3fffe689db service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.169070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f82d0b-52ca-41bc-9547-ccf25fd0f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.170699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f82d0b-52ca-41bc-9547-ccf25fd0f9fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.171355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f82d0b-52ca-41bc-9547-ccf25fd0f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.171895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f82d0b-52ca-41bc-9547-ccf25fd0f9fc admin admin] PATH_INFO: `/v3/projects/be1ae689217f403e930359d2af9d6087/users/79bd2c7d93e64be4b5f77c317a3302f5/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.189916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 996/1996] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:20 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:20.192545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da16ed8-5d7a-4f0f-8dc2-0478f6e0f126 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.200544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f82d0b-52ca-41bc-9547-ccf25fd0f9fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1ae689217f403e930359d2af9d6087, user_id=79bd2c7d93e64be4b5f77c317a3302f5, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.204022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f82d0b-52ca-41bc-9547-ccf25fd0f9fc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.223457 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1001/1997] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:20 2022] PUT /identity/v3/projects/be1ae689217f403e930359d2af9d6087/users/79bd2c7d93e64be4b5f77c317a3302f5/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:20.233945 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608517e-4eae-403a-9716-5ce188e7985c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.234338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608517e-4eae-403a-9716-5ce188e7985c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.234683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608517e-4eae-403a-9716-5ce188e7985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.263651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:20.279434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b608517e-4eae-403a-9716-5ce188e7985c None None] MFA Rules not processed for user `79bd2c7d93e64be4b5f77c317a3302f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:20.283039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b608517e-4eae-403a-9716-5ce188e7985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:20.316272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da16ed8-5d7a-4f0f-8dc2-0478f6e0f126 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.400308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:20.464099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1002/1998] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:20.464221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87436a7-987f-4c1f-9ee1-8bbb3e76553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.465276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87436a7-987f-4c1f-9ee1-8bbb3e76553d admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.465558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87436a7-987f-4c1f-9ee1-8bbb3e76553d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.466071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608517e-4eae-403a-9716-5ce188e7985c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.466318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87436a7-987f-4c1f-9ee1-8bbb3e76553d admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.467138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87436a7-987f-4c1f-9ee1-8bbb3e76553d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.469288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87436a7-987f-4c1f-9ee1-8bbb3e76553d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.479485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608517e-4eae-403a-9716-5ce188e7985c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.487796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d31e-f2af-4c03-bd6d-01426f05a679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.488979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d31e-f2af-4c03-bd6d-01426f05a679 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.489469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d31e-f2af-4c03-bd6d-01426f05a679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.490960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d31e-f2af-4c03-bd6d-01426f05a679 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.491818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d31e-f2af-4c03-bd6d-01426f05a679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.494154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d31e-f2af-4c03-bd6d-01426f05a679 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.534379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 997/1999] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:20 2022] POST /identity/v3/users => generated 291 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:20.537360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87436a7-987f-4c1f-9ee1-8bbb3e76553d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.559011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87436a7-987f-4c1f-9ee1-8bbb3e76553d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.572442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c88bad-cffb-469d-84ae-45fda1eac40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.573927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c88bad-cffb-469d-84ae-45fda1eac40a admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.574523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c88bad-cffb-469d-84ae-45fda1eac40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.574897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c88bad-cffb-469d-84ae-45fda1eac40a admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.575647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c88bad-cffb-469d-84ae-45fda1eac40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.581811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c88bad-cffb-469d-84ae-45fda1eac40a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.606492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1003/2000] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:20 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:20.609450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d31e-f2af-4c03-bd6d-01426f05a679 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.612301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 998/2001] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:20.619463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c88bad-cffb-469d-84ae-45fda1eac40a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.655449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c88bad-cffb-469d-84ae-45fda1eac40a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.719252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d31e-f2af-4c03-bd6d-01426f05a679 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.724955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa6c4f-4c14-4e5c-ad83-57f94ab67536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.725570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa6c4f-4c14-4e5c-ad83-57f94ab67536 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.725845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa6c4f-4c14-4e5c-ad83-57f94ab67536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.726115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa6c4f-4c14-4e5c-ad83-57f94ab67536 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.726738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa6c4f-4c14-4e5c-ad83-57f94ab67536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.729983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa6c4f-4c14-4e5c-ad83-57f94ab67536 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.742437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d17ca9-b6f2-41cc-a2bf-4c9ebef1e3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.743572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d17ca9-b6f2-41cc-a2bf-4c9ebef1e3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.743572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d17ca9-b6f2-41cc-a2bf-4c9ebef1e3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.743863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d17ca9-b6f2-41cc-a2bf-4c9ebef1e3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.744571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d17ca9-b6f2-41cc-a2bf-4c9ebef1e3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.746710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d17ca9-b6f2-41cc-a2bf-4c9ebef1e3a6 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.755865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1004/2002] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:20 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:20.759029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa6c4f-4c14-4e5c-ad83-57f94ab67536 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.762844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 999/2003] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:20.768477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d17ca9-b6f2-41cc-a2bf-4c9ebef1e3a6 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.785934 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d17ca9-b6f2-41cc-a2bf-4c9ebef1e3a6 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.794588 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5319da-d2e8-4af9-b6de-ae72b4af9f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.795260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5319da-d2e8-4af9-b6de-ae72b4af9f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.795541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5319da-d2e8-4af9-b6de-ae72b4af9f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.795812 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5319da-d2e8-4af9-b6de-ae72b4af9f24 admin admin] PATH_INFO: `/v3/projects/bf3446bb2f4042d0a947492c7ac0b3b3/users/d9e18c346c1f4831862a1ec3c59f2a47/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.798365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa6c4f-4c14-4e5c-ad83-57f94ab67536 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.804311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0cd62-725e-459a-9717-7b9faca38c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.806094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cd62-725e-459a-9717-7b9faca38c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.806491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cd62-725e-459a-9717-7b9faca38c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.806868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cd62-725e-459a-9717-7b9faca38c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.807690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0cd62-725e-459a-9717-7b9faca38c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.809451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0cd62-725e-459a-9717-7b9faca38c3d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.820853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5319da-d2e8-4af9-b6de-ae72b4af9f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3446bb2f4042d0a947492c7ac0b3b3, user_id=d9e18c346c1f4831862a1ec3c59f2a47, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:20.825560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5319da-d2e8-4af9-b6de-ae72b4af9f24 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:20.829716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1005/2004] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:20.831309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0cd62-725e-459a-9717-7b9faca38c3d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:20.847633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1000/2005] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:20 2022] PUT /identity/v3/projects/bf3446bb2f4042d0a947492c7ac0b3b3/users/d9e18c346c1f4831862a1ec3c59f2a47/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:20.863909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9085df-e95e-4631-b36f-6470464428b0 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.865995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9085df-e95e-4631-b36f-6470464428b0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.866425 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9085df-e95e-4631-b36f-6470464428b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.866962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0cd62-725e-459a-9717-7b9faca38c3d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:20.909641 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-df9085df-e95e-4631-b36f-6470464428b0 None None] MFA Rules not processed for user `d9e18c346c1f4831862a1ec3c59f2a47`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:20.910903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-df9085df-e95e-4631-b36f-6470464428b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:20.945728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:20.958152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905a157-fdbd-4c5e-9d13-eaa2e057e60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:20.959938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905a157-fdbd-4c5e-9d13-eaa2e057e60e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.960303 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905a157-fdbd-4c5e-9d13-eaa2e057e60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.960746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905a157-fdbd-4c5e-9d13-eaa2e057e60e admin admin] PATH_INFO: `/v3/projects/4fd60a752f9e436594fa9391153cd05c/users/75df4f2a4e2445e58cff659f08d7a013/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.998841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905a157-fdbd-4c5e-9d13-eaa2e057e60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd60a752f9e436594fa9391153cd05c, user_id=75df4f2a4e2445e58cff659f08d7a013, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.003352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905a157-fdbd-4c5e-9d13-eaa2e057e60e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.040330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1006/2006] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:20 2022] PUT /identity/v3/projects/4fd60a752f9e436594fa9391153cd05c/users/75df4f2a4e2445e58cff659f08d7a013/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:21.042337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905a157-fdbd-4c5e-9d13-eaa2e057e60e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:21.082534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1001/2007] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:21.086999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9085df-e95e-4631-b36f-6470464428b0 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:21.092655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:21.110903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9085df-e95e-4631-b36f-6470464428b0 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:21.200244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905a157-fdbd-4c5e-9d13-eaa2e057e60e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:21.208983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1eb23-3a58-41f3-9600-b3bbdaedb695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:21.209939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1eb23-3a58-41f3-9600-b3bbdaedb695 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.211559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1eb23-3a58-41f3-9600-b3bbdaedb695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.211936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1eb23-3a58-41f3-9600-b3bbdaedb695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.214274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1eb23-3a58-41f3-9600-b3bbdaedb695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.217911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1eb23-3a58-41f3-9600-b3bbdaedb695 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.234109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1007/2008] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:21.235442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1eb23-3a58-41f3-9600-b3bbdaedb695 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:21.235574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be4188-4885-41da-9dfc-eb6253b4c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:21.236116 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be4188-4885-41da-9dfc-eb6253b4c412 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.236403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be4188-4885-41da-9dfc-eb6253b4c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.236706 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be4188-4885-41da-9dfc-eb6253b4c412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.238165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be4188-4885-41da-9dfc-eb6253b4c412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.239496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be4188-4885-41da-9dfc-eb6253b4c412 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.252724 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1eb23-3a58-41f3-9600-b3bbdaedb695 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:21.259781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b9d1d-ce42-4189-8006-85b9512cc89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:21.260831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b9d1d-ce42-4189-8006-85b9512cc89a admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.261285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b9d1d-ce42-4189-8006-85b9512cc89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.261551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b9d1d-ce42-4189-8006-85b9512cc89a admin admin] PATH_INFO: `/v3/projects/4fd60a752f9e436594fa9391153cd05c/users/75df4f2a4e2445e58cff659f08d7a013/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.263614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b9d1d-ce42-4189-8006-85b9512cc89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd60a752f9e436594fa9391153cd05c, user_id=75df4f2a4e2445e58cff659f08d7a013, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.266424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b9d1d-ce42-4189-8006-85b9512cc89a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.284675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1002/2010] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:21 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:21.287768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be4188-4885-41da-9dfc-eb6253b4c412 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:21.288693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1008/2010] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:21 2022] PUT /identity/v3/projects/4fd60a752f9e436594fa9391153cd05c/users/75df4f2a4e2445e58cff659f08d7a013/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:21.291015 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e567f-f928-4086-b85a-608e5c614c31 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.291462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e567f-f928-4086-b85a-608e5c614c31 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.292437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e567f-f928-4086-b85a-608e5c614c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.323725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-cf8e567f-f928-4086-b85a-608e5c614c31 None None] MFA Rules not processed for user `75df4f2a4e2445e58cff659f08d7a013`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:21.325263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cf8e567f-f928-4086-b85a-608e5c614c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:21.393482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be4188-4885-41da-9dfc-eb6253b4c412 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:21.403201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc9dca-1067-4a16-9455-58e43795ad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:21.403201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc9dca-1067-4a16-9455-58e43795ad1e admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.403201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc9dca-1067-4a16-9455-58e43795ad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.403201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc9dca-1067-4a16-9455-58e43795ad1e admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.403676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc9dca-1067-4a16-9455-58e43795ad1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.404768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc9dca-1067-4a16-9455-58e43795ad1e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.440667 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1009/2011] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:21.441739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1003/2012] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:21 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:21.443424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e567f-f928-4086-b85a-608e5c614c31 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:21.450687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc9dca-1067-4a16-9455-58e43795ad1e admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:21.454643 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-cccc9dca-1067-4a16-9455-58e43795ad1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:21.456188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e567f-f928-4086-b85a-608e5c614c31 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:21.461678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66208b2-d2ae-441c-9b94-587e505f9e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:21.470359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66208b2-d2ae-441c-9b94-587e505f9e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.470661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66208b2-d2ae-441c-9b94-587e505f9e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.475739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66208b2-d2ae-441c-9b94-587e505f9e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.478322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66208b2-d2ae-441c-9b94-587e505f9e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.481148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66208b2-d2ae-441c-9b94-587e505f9e47 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.496364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1010/2013] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:21.500274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66208b2-d2ae-441c-9b94-587e505f9e47 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:21.513711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66208b2-d2ae-441c-9b94-587e505f9e47 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:21.515454 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:21.522309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259aa4c-40e4-45d4-b7c8-048fedbe1b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:21.523275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259aa4c-40e4-45d4-b7c8-048fedbe1b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.523722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259aa4c-40e4-45d4-b7c8-048fedbe1b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.524134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259aa4c-40e4-45d4-b7c8-048fedbe1b1c admin admin] PATH_INFO: `/v3/projects/631d66ac11084741a26fb3cf72a5f1a3/users/eea596ba60a54e94b63664e366cb7d26/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.542937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc9dca-1067-4a16-9455-58e43795ad1e admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:21.544770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259aa4c-40e4-45d4-b7c8-048fedbe1b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=631d66ac11084741a26fb3cf72a5f1a3, user_id=eea596ba60a54e94b63664e366cb7d26, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.547445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dc2a3-757d-4f04-84d8-b0386e79d3f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:21.547766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259aa4c-40e4-45d4-b7c8-048fedbe1b1c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.548410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc2a3-757d-4f04-84d8-b0386e79d3f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.549135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc2a3-757d-4f04-84d8-b0386e79d3f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.549309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc2a3-757d-4f04-84d8-b0386e79d3f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.565704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1011/2014] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:21 2022] PUT /identity/v3/projects/631d66ac11084741a26fb3cf72a5f1a3/users/eea596ba60a54e94b63664e366cb7d26/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:21.571122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259aa4c-40e4-45d4-b7c8-048fedbe1b1c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:21.629285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dc2a3-757d-4f04-84d8-b0386e79d3f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.630292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dc2a3-757d-4f04-84d8-b0386e79d3f5 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.642399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1004/2015] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:21.658096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:21.673218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259aa4c-40e4-45d4-b7c8-048fedbe1b1c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:21.678548 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e3ecd-0a12-4263-aed0-020633a54e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:21.679206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e3ecd-0a12-4263-aed0-020633a54e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.679483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e3ecd-0a12-4263-aed0-020633a54e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.679752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e3ecd-0a12-4263-aed0-020633a54e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.680437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e3ecd-0a12-4263-aed0-020633a54e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.682868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e3ecd-0a12-4263-aed0-020633a54e2a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.699954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1012/2016] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:21.704216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dc2a3-757d-4f04-84d8-b0386e79d3f5 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:21.720726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dc2a3-757d-4f04-84d8-b0386e79d3f5 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:21.727231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a5474-2fd2-45e4-a096-3f98b697ba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:21.728102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a5474-2fd2-45e4-a096-3f98b697ba37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.728483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a5474-2fd2-45e4-a096-3f98b697ba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.728992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a5474-2fd2-45e4-a096-3f98b697ba37 admin admin] PATH_INFO: `/v3/projects/631d66ac11084741a26fb3cf72a5f1a3/users/eea596ba60a54e94b63664e366cb7d26/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.731869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a5474-2fd2-45e4-a096-3f98b697ba37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631d66ac11084741a26fb3cf72a5f1a3, user_id=eea596ba60a54e94b63664e366cb7d26, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.735160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a5474-2fd2-45e4-a096-3f98b697ba37 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.753671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1005/2017] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:21 2022] PUT /identity/v3/projects/631d66ac11084741a26fb3cf72a5f1a3/users/eea596ba60a54e94b63664e366cb7d26/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:21.777399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a7fb-8d2d-4009-89e1-b088a2657636 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.780175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a7fb-8d2d-4009-89e1-b088a2657636 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.780570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a7fb-8d2d-4009-89e1-b088a2657636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.835172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-02d2a7fb-8d2d-4009-89e1-b088a2657636 None None] MFA Rules not processed for user `eea596ba60a54e94b63664e366cb7d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:21.837006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-02d2a7fb-8d2d-4009-89e1-b088a2657636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:21.995483 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1013/2018] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:22.044103 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a5474-2fd2-45e4-a096-3f98b697ba37 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:22.046419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ca1a5474-2fd2-45e4-a096-3f98b697ba37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:22.131223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2a7fb-8d2d-4009-89e1-b088a2657636 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:22.179000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a5474-2fd2-45e4-a096-3f98b697ba37 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:22.188874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:22.189650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:22.189989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:22.190370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] PATH_INFO: `/v3/users/ccc4febb85214a999e3e99b66e97f1ff` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:22.191710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc4febb85214a999e3e99b66e97f1ff)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:22.198620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:22.250715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2a7fb-8d2d-4009-89e1-b088a2657636 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:22.254999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0a309-888c-43b8-adb3-1b16df131a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:22.256110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0a309-888c-43b8-adb3-1b16df131a72 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:22.256823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0a309-888c-43b8-adb3-1b16df131a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:22.257323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0a309-888c-43b8-adb3-1b16df131a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:22.273338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0a309-888c-43b8-adb3-1b16df131a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:22.275117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0a309-888c-43b8-adb3-1b16df131a72 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:22.296892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1014/2019] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:22.297816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc4febb85214a999e3e99b66e97f1ff'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:22.307584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc4febb85214a999e3e99b66e97f1ff'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:22.310154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc4febb85214a999e3e99b66e97f1ff'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:22.311212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc4febb85214a999e3e99b66e97f1ff'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:22.322365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc4febb85214a999e3e99b66e97f1ff'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:22.350666 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:22.364605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1006/2020] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:22 2022] DELETE /identity/v3/users/ccc4febb85214a999e3e99b66e97f1ff => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:22.370862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afc246-6fc1-48f4-85b8-ed744806db39 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:22.372364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afc246-6fc1-48f4-85b8-ed744806db39 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:22.372894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afc246-6fc1-48f4-85b8-ed744806db39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:22.410802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-42afc246-6fc1-48f4-85b8-ed744806db39 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:22.413290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-42afc246-6fc1-48f4-85b8-ed744806db39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:22.538605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1015/2021] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:22.547354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:22.548813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:22.689286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6b4cb-831b-431d-baf7-ed9146b6f11e admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:22.704753 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efee41a-821d-4ac7-9f7b-8ee6c5f039c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:22.705404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efee41a-821d-4ac7-9f7b-8ee6c5f039c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:22.705684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efee41a-821d-4ac7-9f7b-8ee6c5f039c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:22.705955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efee41a-821d-4ac7-9f7b-8ee6c5f039c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:22.706204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afc246-6fc1-48f4-85b8-ed744806db39 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:22.707893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-42afc246-6fc1-48f4-85b8-ed744806db39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:22.717705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efee41a-821d-4ac7-9f7b-8ee6c5f039c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:22.719139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efee41a-821d-4ac7-9f7b-8ee6c5f039c7 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:22.731430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1007/2022] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:22.763470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:22.857813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afc246-6fc1-48f4-85b8-ed744806db39 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:22.868273 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cb6cf-7c8f-4c5a-a9d7-6ad74ec1fdc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:22.868947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb6cf-7c8f-4c5a-a9d7-6ad74ec1fdc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:22.869226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb6cf-7c8f-4c5a-a9d7-6ad74ec1fdc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:22.869498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb6cf-7c8f-4c5a-a9d7-6ad74ec1fdc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:22.871960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2f6cb6cf-7c8f-4c5a-a9d7-6ad74ec1fdc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:22.951159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cb6cf-7c8f-4c5a-a9d7-6ad74ec1fdc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:22.955189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cb6cf-7c8f-4c5a-a9d7-6ad74ec1fdc8 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:22.982375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1016/2023] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:23.486317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efee41a-821d-4ac7-9f7b-8ee6c5f039c7 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:23.489496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2efee41a-821d-4ac7-9f7b-8ee6c5f039c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:23.515920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efee41a-821d-4ac7-9f7b-8ee6c5f039c7 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:23.521680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cb6cf-7c8f-4c5a-a9d7-6ad74ec1fdc8 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:23.523296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2f6cb6cf-7c8f-4c5a-a9d7-6ad74ec1fdc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:23.524926 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:23.525413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:23.525779 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:23.526788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] PATH_INFO: `/v3/projects/f43a16da8cb843b5a9af27a06ec0a2be` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:23.528910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43a16da8cb843b5a9af27a06ec0a2be)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:23.530992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:23.546397 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cb6cf-7c8f-4c5a-a9d7-6ad74ec1fdc8 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:23.552866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:23.552866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:23.553150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:23.553364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] PATH_INFO: `/v3/users/d9e18c346c1f4831862a1ec3c59f2a47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:23.554424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e18c346c1f4831862a1ec3c59f2a47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:23.556440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:23.615083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e18c346c1f4831862a1ec3c59f2a47'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.625616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e18c346c1f4831862a1ec3c59f2a47'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.627106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e18c346c1f4831862a1ec3c59f2a47'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.627975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e18c346c1f4831862a1ec3c59f2a47'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.628230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43a16da8cb843b5a9af27a06ec0a2be', 'request_id': 'req-868d6d17-b167-443d-b71e-d0e86b294d34'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.639067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aaefef4a-a9d3-4ed3-a8e6-67ffd9646320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e18c346c1f4831862a1ec3c59f2a47'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.641368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43a16da8cb843b5a9af27a06ec0a2be', 'request_id': 'req-868d6d17-b167-443d-b71e-d0e86b294d34'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.653126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43a16da8cb843b5a9af27a06ec0a2be', 'request_id': 'req-868d6d17-b167-443d-b71e-d0e86b294d34'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.670413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] The token cache is being invalidate because project f43a16da8cb843b5a9af27a06ec0a2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:23.671083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.671949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.674360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1008/2024] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:23 2022] DELETE /identity/v3/projects/f43a16da8cb843b5a9af27a06ec0a2be => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:23.677915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1017/2025] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:23 2022] DELETE /identity/v3/users/d9e18c346c1f4831862a1ec3c59f2a47 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:23.679145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:23.680876 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:23.682881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abebaf-fb6a-4abd-811b-9289c0a14da2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:23.683174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abebaf-fb6a-4abd-811b-9289c0a14da2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:23.683424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abebaf-fb6a-4abd-811b-9289c0a14da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:23.709611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b7abebaf-fb6a-4abd-811b-9289c0a14da2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:23.712316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b7abebaf-fb6a-4abd-811b-9289c0a14da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:23.764300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d6d17-b167-443d-b71e-d0e86b294d34 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:23.789263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:23.812612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:23.825535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1018/2026] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:23.837366 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abebaf-fb6a-4abd-811b-9289c0a14da2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:23.840888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b7abebaf-fb6a-4abd-811b-9289c0a14da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:23.868468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:23.869155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:23.869484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:23.869868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] PATH_INFO: `/v3/users/c9255beace23422bb5d823e930876ea0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:23.870966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9255beace23422bb5d823e930876ea0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:23.872948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:23.965096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abebaf-fb6a-4abd-811b-9289c0a14da2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:23.966802 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9255beace23422bb5d823e930876ea0'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.970124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0793d-48c7-46b1-a134-d2b60f2ad3b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:23.972066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0793d-48c7-46b1-a134-d2b60f2ad3b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:23.972612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0793d-48c7-46b1-a134-d2b60f2ad3b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:23.972916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0793d-48c7-46b1-a134-d2b60f2ad3b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:23.976477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9255beace23422bb5d823e930876ea0'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.977474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9255beace23422bb5d823e930876ea0'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.978484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9255beace23422bb5d823e930876ea0'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.985216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0793d-48c7-46b1-a134-d2b60f2ad3b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:23.987355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0793d-48c7-46b1-a134-d2b60f2ad3b1 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:23.989400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-56a47f0a-0eaa-463b-a5b3-826f04d13a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9255beace23422bb5d823e930876ea0'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.000689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1019/2027] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:24.017995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1009/2028] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:23 2022] DELETE /identity/v3/users/c9255beace23422bb5d823e930876ea0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:24.145797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0793d-48c7-46b1-a134-d2b60f2ad3b1 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:24.147289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-43e0793d-48c7-46b1-a134-d2b60f2ad3b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:24.165791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0793d-48c7-46b1-a134-d2b60f2ad3b1 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:24.308076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:24.308753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:24.309104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:24.309959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] PATH_INFO: `/v3/users/f6018b56ae824ac6a251d1b50f6b9f8c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:24.311257 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6018b56ae824ac6a251d1b50f6b9f8c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:24.313719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:24.407501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6018b56ae824ac6a251d1b50f6b9f8c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.429069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6018b56ae824ac6a251d1b50f6b9f8c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.436584 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6018b56ae824ac6a251d1b50f6b9f8c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.437344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6018b56ae824ac6a251d1b50f6b9f8c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.452255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6018b56ae824ac6a251d1b50f6b9f8c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.502756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1020/2029] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:24 2022] DELETE /identity/v3/users/f6018b56ae824ac6a251d1b50f6b9f8c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:24.506596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ed95-ef2a-46e6-81fb-1f18ae124303 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:24.507551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ed95-ef2a-46e6-81fb-1f18ae124303 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:24.507996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ed95-ef2a-46e6-81fb-1f18ae124303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:24.547904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-fb82ed95-ef2a-46e6-81fb-1f18ae124303 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:24.549194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-fb82ed95-ef2a-46e6-81fb-1f18ae124303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:24.654365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1010/2030] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:24.690276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:24.691655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:24.715235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:24.739485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82ed95-ef2a-46e6-81fb-1f18ae124303 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:24.741084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-fb82ed95-ef2a-46e6-81fb-1f18ae124303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:24.770588 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82ed95-ef2a-46e6-81fb-1f18ae124303 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:24.785224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:24.786146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:24.786845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:24.788699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] PATH_INFO: `/v3/projects/bf3446bb2f4042d0a947492c7ac0b3b3` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:24.792196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3446bb2f4042d0a947492c7ac0b3b3)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:24.802163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:24.850716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12391ab-7885-44f4-9e2e-0831540ff2a0 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:24.859525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ed2a7-0dea-4c4e-bcd6-e415c31a6c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:24.860121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ed2a7-0dea-4c4e-bcd6-e415c31a6c51 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:24.860460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ed2a7-0dea-4c4e-bcd6-e415c31a6c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:24.860857 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ed2a7-0dea-4c4e-bcd6-e415c31a6c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:24.884246 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ed2a7-0dea-4c4e-bcd6-e415c31a6c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:24.887818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ed2a7-0dea-4c4e-bcd6-e415c31a6c51 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:24.917947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1021/2031] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:24.919955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ed2a7-0dea-4c4e-bcd6-e415c31a6c51 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:24.926730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-157ed2a7-0dea-4c4e-bcd6-e415c31a6c51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:24.947323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:24.950172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3446bb2f4042d0a947492c7ac0b3b3', 'request_id': 'req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.963507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ed2a7-0dea-4c4e-bcd6-e415c31a6c51 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:24.965033 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3446bb2f4042d0a947492c7ac0b3b3', 'request_id': 'req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.976925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3446bb2f4042d0a947492c7ac0b3b3', 'request_id': 'req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.000555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] The token cache is being invalidate because project bf3446bb2f4042d0a947492c7ac0b3b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:25.001141 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.002586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.005859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1011/2032] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:24 2022] DELETE /identity/v3/projects/bf3446bb2f4042d0a947492c7ac0b3b3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:25.006848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:25.012650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.098615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:25.099282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.099582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.099985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] PATH_INFO: `/v3/users/79bd2c7d93e64be4b5f77c317a3302f5` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.101398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bd2c7d93e64be4b5f77c317a3302f5)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:25.103720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:25.165718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e9619-6f08-4fde-9fb6-75ce81ee50fc admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:25.187146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:25.189651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.190809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.192518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] PATH_INFO: `/v3/projects/bdd197e4d325466f863add3f575c2082` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.195412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd197e4d325466f863add3f575c2082)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:25.198453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:25.204931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bd2c7d93e64be4b5f77c317a3302f5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.221111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bd2c7d93e64be4b5f77c317a3302f5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.221871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bd2c7d93e64be4b5f77c317a3302f5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.222503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bd2c7d93e64be4b5f77c317a3302f5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.238302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bd2c7d93e64be4b5f77c317a3302f5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.281753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1022/2033] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:24 2022] DELETE /identity/v3/users/79bd2c7d93e64be4b5f77c317a3302f5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:25.282664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:25.286450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.295757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd197e4d325466f863add3f575c2082', 'request_id': 'req-02434f5c-e252-4a54-abf6-6933073388e4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.321836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd197e4d325466f863add3f575c2082', 'request_id': 'req-02434f5c-e252-4a54-abf6-6933073388e4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.339627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd197e4d325466f863add3f575c2082', 'request_id': 'req-02434f5c-e252-4a54-abf6-6933073388e4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.354919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:25.362302 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] The token cache is being invalidate because project bdd197e4d325466f863add3f575c2082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:25.363230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.363943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02434f5c-e252-4a54-abf6-6933073388e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.371120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1012/2034] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:25 2022] DELETE /identity/v3/projects/bdd197e4d325466f863add3f575c2082 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:25.372531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f99c4-b1a3-4a7b-94fd-e29da743e554 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.372931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f99c4-b1a3-4a7b-94fd-e29da743e554 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.373135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f99c4-b1a3-4a7b-94fd-e29da743e554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.404342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-198f99c4-b1a3-4a7b-94fd-e29da743e554 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:25.405829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-198f99c4-b1a3-4a7b-94fd-e29da743e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.432857 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf0acf-eeea-4d46-9822-a9bc86324a06 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:25.438760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:25.439412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.439699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.439974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] PATH_INFO: `/v3/users/eea596ba60a54e94b63664e366cb7d26` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.441765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea596ba60a54e94b63664e366cb7d26)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:25.443727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:25.495222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1013/2035] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:25.495222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f99c4-b1a3-4a7b-94fd-e29da743e554 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:25.497150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-198f99c4-b1a3-4a7b-94fd-e29da743e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.505554 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:25.510888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f99c4-b1a3-4a7b-94fd-e29da743e554 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:25.513005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea596ba60a54e94b63664e366cb7d26'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.517985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:25.518798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.519483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.519731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] PATH_INFO: `/v3/projects/714e70d902f0499ca61d42ca3281d64c` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.521176 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] RBAC: Authorizing `identity:delete_project(project_id=714e70d902f0499ca61d42ca3281d64c)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:25.521299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea596ba60a54e94b63664e366cb7d26'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.521886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea596ba60a54e94b63664e366cb7d26'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.522511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea596ba60a54e94b63664e366cb7d26'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.523198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:25.530245 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c95927c3-079c-4626-a22d-757444f6a77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea596ba60a54e94b63664e366cb7d26'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.549618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1023/2036] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:25 2022] DELETE /identity/v3/users/eea596ba60a54e94b63664e366cb7d26 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:25.554146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1e0e3-311a-4920-a459-b8f46b090c5b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.554847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1e0e3-311a-4920-a459-b8f46b090c5b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.554847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1e0e3-311a-4920-a459-b8f46b090c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.579787 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-06f1e0e3-311a-4920-a459-b8f46b090c5b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:25.581024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-06f1e0e3-311a-4920-a459-b8f46b090c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.584848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714e70d902f0499ca61d42ca3281d64c', 'request_id': 'req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.591742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714e70d902f0499ca61d42ca3281d64c', 'request_id': 'req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.598970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714e70d902f0499ca61d42ca3281d64c', 'request_id': 'req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.615570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] The token cache is being invalidate because project 714e70d902f0499ca61d42ca3281d64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:25.616028 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.617257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.619409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1014/2037] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:25 2022] DELETE /identity/v3/projects/714e70d902f0499ca61d42ca3281d64c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:25.620823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:25.622910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.655666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1024/2038] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:25.656500 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1e0e3-311a-4920-a459-b8f46b090c5b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:25.657828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-06f1e0e3-311a-4920-a459-b8f46b090c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.670434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1e0e3-311a-4920-a459-b8f46b090c5b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:25.675104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:25.676008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.676286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.676558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] PATH_INFO: `/v3/users/a6d301265fa34744addb4696e870bb8a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.677749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d301265fa34744addb4696e870bb8a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:25.679666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:25.702728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c72a2-3b0e-4c6f-805e-fb6f4c0c776d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:25.707257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0149a39-c930-4e08-b2f2-e099c9c50deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:25.707847 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0149a39-c930-4e08-b2f2-e099c9c50deb service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.708121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0149a39-c930-4e08-b2f2-e099c9c50deb service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.708388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0149a39-c930-4e08-b2f2-e099c9c50deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.710658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d0149a39-c930-4e08-b2f2-e099c9c50deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.727444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0149a39-c930-4e08-b2f2-e099c9c50deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:25.729142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0149a39-c930-4e08-b2f2-e099c9c50deb service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:25.739626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1015/2039] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:25.740752 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe030-0d62-4ef7-b97c-956a068f7452 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.741041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe030-0d62-4ef7-b97c-956a068f7452 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.741309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe030-0d62-4ef7-b97c-956a068f7452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.753608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:25.760788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d301265fa34744addb4696e870bb8a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.767190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c2ffe030-0d62-4ef7-b97c-956a068f7452 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:25.768300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c2ffe030-0d62-4ef7-b97c-956a068f7452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.773206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d301265fa34744addb4696e870bb8a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.774578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d301265fa34744addb4696e870bb8a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.775204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d301265fa34744addb4696e870bb8a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.780000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1016/2040] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:25.784798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffe030-0d62-4ef7-b97c-956a068f7452 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:25.785028 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d301265fa34744addb4696e870bb8a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:25.811519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1025/2041] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:25 2022] DELETE /identity/v3/users/a6d301265fa34744addb4696e870bb8a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:25.817158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffe030-0d62-4ef7-b97c-956a068f7452 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:25.869382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:25.871657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.935820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707f94-0794-4c23-b512-6e596e7a21ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:25.936838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707f94-0794-4c23-b512-6e596e7a21ee admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.937961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707f94-0794-4c23-b512-6e596e7a21ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.938320 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707f94-0794-4c23-b512-6e596e7a21ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.939090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a707f94-0794-4c23-b512-6e596e7a21ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:25.939520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a707f94-0794-4c23-b512-6e596e7a21ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:25.944263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a707f94-0794-4c23-b512-6e596e7a21ee admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:25.973068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1017/2042] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:22:25.977072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707f94-0794-4c23-b512-6e596e7a21ee admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:25.978376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97948b94-88d7-42cf-91ba-fd928369288b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:25.980263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8a707f94-0794-4c23-b512-6e596e7a21ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.984967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:25.985943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.986345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.986664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] PATH_INFO: `/v3/projects/631d66ac11084741a26fb3cf72a5f1a3` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.987843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=631d66ac11084741a26fb3cf72a5f1a3)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:25.990525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:25.996801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707f94-0794-4c23-b512-6e596e7a21ee admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.003473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33a60f-6b31-4cdf-b563-d7e8f4e43af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.004297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33a60f-6b31-4cdf-b563-d7e8f4e43af1 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.004499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33a60f-6b31-4cdf-b563-d7e8f4e43af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.004806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33a60f-6b31-4cdf-b563-d7e8f4e43af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.005605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33a60f-6b31-4cdf-b563-d7e8f4e43af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.007904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33a60f-6b31-4cdf-b563-d7e8f4e43af1 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:26.061093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:26.061623 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631d66ac11084741a26fb3cf72a5f1a3', 'request_id': 'req-338315b4-235d-49dc-ad90-6554d828e49c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.077882 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631d66ac11084741a26fb3cf72a5f1a3', 'request_id': 'req-338315b4-235d-49dc-ad90-6554d828e49c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.092726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631d66ac11084741a26fb3cf72a5f1a3', 'request_id': 'req-338315b4-235d-49dc-ad90-6554d828e49c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.103207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1018/2043] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:25 2022] POST /identity/v3/projects => generated 399 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:26.110056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33a60f-6b31-4cdf-b563-d7e8f4e43af1 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.125100 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] The token cache is being invalidate because project 631d66ac11084741a26fb3cf72a5f1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:26.125397 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.126088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-338315b4-235d-49dc-ad90-6554d828e49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.133055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1026/2044] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:25 2022] DELETE /identity/v3/projects/631d66ac11084741a26fb3cf72a5f1a3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:26.134782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7faad3-3a0d-4c82-98e5-124770673fcd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.135704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7faad3-3a0d-4c82-98e5-124770673fcd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.136080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7faad3-3a0d-4c82-98e5-124770673fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.179467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-af7faad3-3a0d-4c82-98e5-124770673fcd None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:26.181339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-af7faad3-3a0d-4c82-98e5-124770673fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.239238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33a60f-6b31-4cdf-b563-d7e8f4e43af1 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.251887 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f37ef-cddc-4656-81d8-a59aa0cb7b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.254515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f37ef-cddc-4656-81d8-a59aa0cb7b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.254813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f37ef-cddc-4656-81d8-a59aa0cb7b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.255087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f37ef-cddc-4656-81d8-a59aa0cb7b85 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.255734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f37ef-cddc-4656-81d8-a59aa0cb7b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.258796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f37ef-cddc-4656-81d8-a59aa0cb7b85 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:26.271791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:26.293958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1019/2045] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:26 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:26.295479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f37ef-cddc-4656-81d8-a59aa0cb7b85 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.297286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1027/2046] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:26.298496 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7faad3-3a0d-4c82-98e5-124770673fcd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.301056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-208f37ef-cddc-4656-81d8-a59aa0cb7b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.301956 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-af7faad3-3a0d-4c82-98e5-124770673fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.321284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f37ef-cddc-4656-81d8-a59aa0cb7b85 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.323402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7faad3-3a0d-4c82-98e5-124770673fcd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.330998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.331997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0122b9-5ad2-4f29-aa3d-1dbab59e7d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.332207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.332413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.332971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] PATH_INFO: `/v3/projects/be1ae689217f403e930359d2af9d6087` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.333147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0122b9-5ad2-4f29-aa3d-1dbab59e7d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.333592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0122b9-5ad2-4f29-aa3d-1dbab59e7d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.333927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0122b9-5ad2-4f29-aa3d-1dbab59e7d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.334050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1ae689217f403e930359d2af9d6087)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.335123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0122b9-5ad2-4f29-aa3d-1dbab59e7d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.336702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:26.340586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0122b9-5ad2-4f29-aa3d-1dbab59e7d26 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:26.357829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1028/2047] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:26.357829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69199-8d37-4f9a-93ef-ea44e179b0d7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.357829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69199-8d37-4f9a-93ef-ea44e179b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.357829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69199-8d37-4f9a-93ef-ea44e179b0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.382638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ccf69199-8d37-4f9a-93ef-ea44e179b0d7 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:26.384270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ccf69199-8d37-4f9a-93ef-ea44e179b0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.403104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1ae689217f403e930359d2af9d6087', 'request_id': 'req-b0362fcb-b293-44a5-b440-c515ccc7c330'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.410353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1ae689217f403e930359d2af9d6087', 'request_id': 'req-b0362fcb-b293-44a5-b440-c515ccc7c330'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.418730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1ae689217f403e930359d2af9d6087', 'request_id': 'req-b0362fcb-b293-44a5-b440-c515ccc7c330'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.434844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] The token cache is being invalidate because project be1ae689217f403e930359d2af9d6087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:26.435129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.435809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.437720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1020/2048] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:26 2022] DELETE /identity/v3/projects/be1ae689217f403e930359d2af9d6087 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:26.439413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.440599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.460917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1029/2049] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:26.463051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf69199-8d37-4f9a-93ef-ea44e179b0d7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.465570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ccf69199-8d37-4f9a-93ef-ea44e179b0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.478257 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf69199-8d37-4f9a-93ef-ea44e179b0d7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.484883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.485605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.486111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.486234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] PATH_INFO: `/v3/users/7fc365298e234e74ab304845a76bf61f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.487295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc365298e234e74ab304845a76bf61f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.489755 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:26.517476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0362fcb-b293-44a5-b440-c515ccc7c330 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.524731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.525023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.525485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.526378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] PATH_INFO: `/v3/projects/c8dba10dfc144dfc91b919e9fe9d5ae8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.529404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8dba10dfc144dfc91b919e9fe9d5ae8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.531660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:26.554248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:26.558786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc365298e234e74ab304845a76bf61f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.572142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc365298e234e74ab304845a76bf61f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.573205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc365298e234e74ab304845a76bf61f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.574111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc365298e234e74ab304845a76bf61f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.582494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc365298e234e74ab304845a76bf61f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.603163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1030/2050] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:26 2022] DELETE /identity/v3/users/7fc365298e234e74ab304845a76bf61f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:26.603753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.606139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.608151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dba10dfc144dfc91b919e9fe9d5ae8', 'request_id': 'req-43076a8a-0f0f-4953-81c6-f685b48c3d37'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.613882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dba10dfc144dfc91b919e9fe9d5ae8', 'request_id': 'req-43076a8a-0f0f-4953-81c6-f685b48c3d37'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.623943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dba10dfc144dfc91b919e9fe9d5ae8', 'request_id': 'req-43076a8a-0f0f-4953-81c6-f685b48c3d37'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.641878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] The token cache is being invalidate because project c8dba10dfc144dfc91b919e9fe9d5ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:26.642091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.642750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.644242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1021/2051] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:26 2022] DELETE /identity/v3/projects/c8dba10dfc144dfc91b919e9fe9d5ae8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:26.645024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.646303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.677879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:26.694131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb43e8-a5cb-47a5-b066-1da67c214457 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.699775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378566d0-cb02-4815-8b8c-147cd521eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.700389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378566d0-cb02-4815-8b8c-147cd521eb4c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.701166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378566d0-cb02-4815-8b8c-147cd521eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.701166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378566d0-cb02-4815-8b8c-147cd521eb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.701617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378566d0-cb02-4815-8b8c-147cd521eb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.703255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378566d0-cb02-4815-8b8c-147cd521eb4c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:26.716764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1031/2052] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:26.716764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378566d0-cb02-4815-8b8c-147cd521eb4c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.718191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-378566d0-cb02-4815-8b8c-147cd521eb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.725824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43076a8a-0f0f-4953-81c6-f685b48c3d37 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.730830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378566d0-cb02-4815-8b8c-147cd521eb4c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.731632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.732341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.732640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.732929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] PATH_INFO: `/v3/users/75df4f2a4e2445e58cff659f08d7a013` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.734048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75df4f2a4e2445e58cff659f08d7a013)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.735742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f1e4e-ed79-47ec-b81a-67b65f30b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.735975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:26.736323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1e4e-ed79-47ec-b81a-67b65f30b346 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.736597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1e4e-ed79-47ec-b81a-67b65f30b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.736898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1e4e-ed79-47ec-b81a-67b65f30b346 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.737587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f1e4e-ed79-47ec-b81a-67b65f30b346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:26.737880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f1e4e-ed79-47ec-b81a-67b65f30b346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.739469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f1e4e-ed79-47ec-b81a-67b65f30b346 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:26.751868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1032/2053] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:26.753218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aa39b-3313-4b3e-8d72-4f9f332d51cf None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.753493 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aa39b-3313-4b3e-8d72-4f9f332d51cf None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.753789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aa39b-3313-4b3e-8d72-4f9f332d51cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.773891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ac4aa39b-3313-4b3e-8d72-4f9f332d51cf None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:26.775299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ac4aa39b-3313-4b3e-8d72-4f9f332d51cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.783778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1033/2054] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:26.785069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced71b7-3d65-45e8-8d4c-bb3bf5cf4fa5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.785346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced71b7-3d65-45e8-8d4c-bb3bf5cf4fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.785612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced71b7-3d65-45e8-8d4c-bb3bf5cf4fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.792577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75df4f2a4e2445e58cff659f08d7a013'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.800948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75df4f2a4e2445e58cff659f08d7a013'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.801583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75df4f2a4e2445e58cff659f08d7a013'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.802198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75df4f2a4e2445e58cff659f08d7a013'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.805523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2ced71b7-3d65-45e8-8d4c-bb3bf5cf4fa5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:26.806716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2ced71b7-3d65-45e8-8d4c-bb3bf5cf4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.809692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75df4f2a4e2445e58cff659f08d7a013'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:26.814924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1034/2055] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:26.815669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced71b7-3d65-45e8-8d4c-bb3bf5cf4fa5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.816917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2ced71b7-3d65-45e8-8d4c-bb3bf5cf4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.829281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced71b7-3d65-45e8-8d4c-bb3bf5cf4fa5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.834151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1022/2056] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:26 2022] DELETE /identity/v3/users/75df4f2a4e2445e58cff659f08d7a013 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:26.835090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.835197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f2855-8cf8-4b7b-bdd5-7ff5b7e06725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.835820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f2855-8cf8-4b7b-bdd5-7ff5b7e06725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.836051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f2855-8cf8-4b7b-bdd5-7ff5b7e06725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.836327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f2855-8cf8-4b7b-bdd5-7ff5b7e06725 admin admin] PATH_INFO: `/v3/projects/df275d5aead44de8b6ade1527fe6144d/users/e4835bec10064a8db7a640060b8315f9/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.836727 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.852144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f2855-8cf8-4b7b-bdd5-7ff5b7e06725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df275d5aead44de8b6ade1527fe6144d, user_id=e4835bec10064a8db7a640060b8315f9, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.854902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f2855-8cf8-4b7b-bdd5-7ff5b7e06725 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:26.859491 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:26.871446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1035/2057] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:26 2022] PUT /identity/v3/projects/df275d5aead44de8b6ade1527fe6144d/users/e4835bec10064a8db7a640060b8315f9/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:26.872523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f2855-8cf8-4b7b-bdd5-7ff5b7e06725 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:26.874304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-492f2855-8cf8-4b7b-bdd5-7ff5b7e06725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.915904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834ac3-2185-42f1-8a2f-b9039c64e783 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.941618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f2855-8cf8-4b7b-bdd5-7ff5b7e06725 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:26.945842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980051c-cfc2-4601-82ad-89da41dc6964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.946684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980051c-cfc2-4601-82ad-89da41dc6964 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.946961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980051c-cfc2-4601-82ad-89da41dc6964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.947231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980051c-cfc2-4601-82ad-89da41dc6964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.949676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3980051c-cfc2-4601-82ad-89da41dc6964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.981404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91e0df-95e7-4777-b6d2-62d127be9e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:26.982168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e0df-95e7-4777-b6d2-62d127be9e2c admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.983973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e0df-95e7-4777-b6d2-62d127be9e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.983973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e0df-95e7-4777-b6d2-62d127be9e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.983973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91e0df-95e7-4777-b6d2-62d127be9e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:26.985702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91e0df-95e7-4777-b6d2-62d127be9e2c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.018619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1023/2058] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:26 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:27.021035 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8cdb6-60a6-45e2-b121-1928a42f2d9b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.021545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8cdb6-60a6-45e2-b121-1928a42f2d9b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.021829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8cdb6-60a6-45e2-b121-1928a42f2d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.055244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d8b8cdb6-60a6-45e2-b121-1928a42f2d9b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:27.056434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d8b8cdb6-60a6-45e2-b121-1928a42f2d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.061137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980051c-cfc2-4601-82ad-89da41dc6964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.063289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980051c-cfc2-4601-82ad-89da41dc6964 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.079624 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1036/2059] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:27.081091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d5b5-1c02-48ae-900b-66d498629c58 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.081373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d5b5-1c02-48ae-900b-66d498629c58 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.081641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d5b5-1c02-48ae-900b-66d498629c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.117989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b838d5b5-1c02-48ae-900b-66d498629c58 None None] MFA Rules not processed for user `e4835bec10064a8db7a640060b8315f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:27.119330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b838d5b5-1c02-48ae-900b-66d498629c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.136574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1024/2060] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:27.137725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8cdb6-60a6-45e2-b121-1928a42f2d9b None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.150137 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8cdb6-60a6-45e2-b121-1928a42f2d9b None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.160849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d4a6-ddc5-40b2-baf9-f75bc65aab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.161826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d4a6-ddc5-40b2-baf9-f75bc65aab17 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.162338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d4a6-ddc5-40b2-baf9-f75bc65aab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.162748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d4a6-ddc5-40b2-baf9-f75bc65aab17 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.163719 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633d4a6-ddc5-40b2-baf9-f75bc65aab17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.166871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633d4a6-ddc5-40b2-baf9-f75bc65aab17 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.176530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:27.197210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1025/2061] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/users => generated 286 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:27.202384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d4a6-ddc5-40b2-baf9-f75bc65aab17 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.215207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d4a6-ddc5-40b2-baf9-f75bc65aab17 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.221775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6fdf2-6b57-4f9b-b3f6-1fb34455d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.222511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6fdf2-6b57-4f9b-b3f6-1fb34455d573 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.223189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6fdf2-6b57-4f9b-b3f6-1fb34455d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.223551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6fdf2-6b57-4f9b-b3f6-1fb34455d573 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.224314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6fdf2-6b57-4f9b-b3f6-1fb34455d573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:27.224826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6fdf2-6b57-4f9b-b3f6-1fb34455d573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.226082 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1037/2062] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:27.227436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d5b5-1c02-48ae-900b-66d498629c58 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.227850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6fdf2-6b57-4f9b-b3f6-1fb34455d573 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.241192 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d5b5-1c02-48ae-900b-66d498629c58 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.247437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1026/2063] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:27.248300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6fdf2-6b57-4f9b-b3f6-1fb34455d573 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.248978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be4671-ffa2-4c3f-840a-3433574c4b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.249960 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be4671-ffa2-4c3f-840a-3433574c4b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.250482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be4671-ffa2-4c3f-840a-3433574c4b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.250896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be4671-ffa2-4c3f-840a-3433574c4b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.251966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be4671-ffa2-4c3f-840a-3433574c4b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.254030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be4671-ffa2-4c3f-840a-3433574c4b21 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.261677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6fdf2-6b57-4f9b-b3f6-1fb34455d573 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.266998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8a5a1-4400-4e27-a0bb-85680a688cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.270832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8a5a1-4400-4e27-a0bb-85680a688cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.270832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8a5a1-4400-4e27-a0bb-85680a688cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.270832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8a5a1-4400-4e27-a0bb-85680a688cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.270832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8a5a1-4400-4e27-a0bb-85680a688cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.271604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1038/2064] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:27.272897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8a5a1-4400-4e27-a0bb-85680a688cd8 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.274314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be4671-ffa2-4c3f-840a-3433574c4b21 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.294058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be4671-ffa2-4c3f-840a-3433574c4b21 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.304767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:27.306916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b01d1-fb53-4b75-a7e8-d7aa10c31814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.310938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b01d1-fb53-4b75-a7e8-d7aa10c31814 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.311802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b01d1-fb53-4b75-a7e8-d7aa10c31814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.312291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b01d1-fb53-4b75-a7e8-d7aa10c31814 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.314219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b01d1-fb53-4b75-a7e8-d7aa10c31814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.317639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b01d1-fb53-4b75-a7e8-d7aa10c31814 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.318166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1027/2065] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/projects => generated 399 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:27.319378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8a5a1-4400-4e27-a0bb-85680a688cd8 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.366729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1039/2066] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:27.367781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b01d1-fb53-4b75-a7e8-d7aa10c31814 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.429289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8a5a1-4400-4e27-a0bb-85680a688cd8 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.470319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b01d1-fb53-4b75-a7e8-d7aa10c31814 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.475685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9a225-8c99-44d8-99a2-d0f0463816ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.476781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9a225-8c99-44d8-99a2-d0f0463816ea admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.477126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9a225-8c99-44d8-99a2-d0f0463816ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.477473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9a225-8c99-44d8-99a2-d0f0463816ea admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.478474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9a225-8c99-44d8-99a2-d0f0463816ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.481121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9a225-8c99-44d8-99a2-d0f0463816ea admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.508579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1040/2067] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/users => generated 306 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:27.508829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75492057-fc90-4242-8bfd-6f3dbe4a3d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.508829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75492057-fc90-4242-8bfd-6f3dbe4a3d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.509036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9a225-8c99-44d8-99a2-d0f0463816ea admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.509120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75492057-fc90-4242-8bfd-6f3dbe4a3d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.509120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75492057-fc90-4242-8bfd-6f3dbe4a3d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.509120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75492057-fc90-4242-8bfd-6f3dbe4a3d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.509725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75492057-fc90-4242-8bfd-6f3dbe4a3d60 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.511169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-14d9a225-8c99-44d8-99a2-d0f0463816ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.522861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1028/2068] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:27.523773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75492057-fc90-4242-8bfd-6f3dbe4a3d60 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.526167 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9a225-8c99-44d8-99a2-d0f0463816ea admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.532262 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.533002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.533367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.533613 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] PATH_INFO: `/v3/projects/4fd60a752f9e436594fa9391153cd05c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.534727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd60a752f9e436594fa9391153cd05c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.536900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.543183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75492057-fc90-4242-8bfd-6f3dbe4a3d60 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.548505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22915b-6bc3-440a-aed9-1a145e5e25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.551912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22915b-6bc3-440a-aed9-1a145e5e25a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.551912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22915b-6bc3-440a-aed9-1a145e5e25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.551912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22915b-6bc3-440a-aed9-1a145e5e25a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.551912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22915b-6bc3-440a-aed9-1a145e5e25a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.552438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22915b-6bc3-440a-aed9-1a145e5e25a1 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.583027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1029/2069] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/users => generated 290 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:27.584171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22915b-6bc3-440a-aed9-1a145e5e25a1 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.594991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22915b-6bc3-440a-aed9-1a145e5e25a1 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.597427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd60a752f9e436594fa9391153cd05c', 'request_id': 'req-3ef429cd-934f-42f8-9b8b-d3c87b256a71'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.607224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd60a752f9e436594fa9391153cd05c', 'request_id': 'req-3ef429cd-934f-42f8-9b8b-d3c87b256a71'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.616455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd60a752f9e436594fa9391153cd05c', 'request_id': 'req-3ef429cd-934f-42f8-9b8b-d3c87b256a71'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.636767 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] The token cache is being invalidate because project 4fd60a752f9e436594fa9391153cd05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:27.637061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.637749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.642510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1041/2070] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:27 2022] DELETE /identity/v3/projects/4fd60a752f9e436594fa9391153cd05c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:27.642510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.642510 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.662785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:27.667448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1859e-5252-4a41-b711-b6d187ea63ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.668063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1859e-5252-4a41-b711-b6d187ea63ef admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.668343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1859e-5252-4a41-b711-b6d187ea63ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.668612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1859e-5252-4a41-b711-b6d187ea63ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.669280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1859e-5252-4a41-b711-b6d187ea63ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.671009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1859e-5252-4a41-b711-b6d187ea63ef admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.683492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1030/2071] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:27.684331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1859e-5252-4a41-b711-b6d187ea63ef admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.686676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-53c1859e-5252-4a41-b711-b6d187ea63ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.699555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1859e-5252-4a41-b711-b6d187ea63ef admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.703972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.704580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.704905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.705173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] PATH_INFO: `/v3/projects/8b1d3dee96b24ea1acae3aec4cc0af43` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.706436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1d3dee96b24ea1acae3aec4cc0af43)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.708318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.709091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef429cd-934f-42f8-9b8b-d3c87b256a71 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.713911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4662-d8a0-44bb-b727-10191a40667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.714563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4662-d8a0-44bb-b727-10191a40667c admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.714842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4662-d8a0-44bb-b727-10191a40667c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.715120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4662-d8a0-44bb-b727-10191a40667c admin admin] PATH_INFO: `/v3/projects/26cdd781fce645c8a44ccceadaaba9db/users/b2aa64efbefa4e64ab53a80d0a75bc93/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.727672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:27.735362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd4662-d8a0-44bb-b727-10191a40667c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cdd781fce645c8a44ccceadaaba9db, user_id=b2aa64efbefa4e64ab53a80d0a75bc93, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.739306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd4662-d8a0-44bb-b727-10191a40667c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.754365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1042/2072] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:27 2022] PUT /identity/v3/projects/26cdd781fce645c8a44ccceadaaba9db/users/b2aa64efbefa4e64ab53a80d0a75bc93/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:27.755204 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4662-d8a0-44bb-b727-10191a40667c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.756941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b1dd4662-d8a0-44bb-b727-10191a40667c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.766692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1d3dee96b24ea1acae3aec4cc0af43', 'request_id': 'req-9ad76c9e-6310-4606-a71b-63128f2e71f3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.772373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1d3dee96b24ea1acae3aec4cc0af43', 'request_id': 'req-9ad76c9e-6310-4606-a71b-63128f2e71f3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.782134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1d3dee96b24ea1acae3aec4cc0af43', 'request_id': 'req-9ad76c9e-6310-4606-a71b-63128f2e71f3'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.795048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] The token cache is being invalidate because project 8b1d3dee96b24ea1acae3aec4cc0af43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:27.795235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.795909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9ad76c9e-6310-4606-a71b-63128f2e71f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.797795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1031/2073] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:27 2022] DELETE /identity/v3/projects/8b1d3dee96b24ea1acae3aec4cc0af43 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:27.799297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4422da3-cd1b-4562-a539-0d765aa2a3f8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.799716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4422da3-cd1b-4562-a539-0d765aa2a3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.800117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4422da3-cd1b-4562-a539-0d765aa2a3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.821287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-b4422da3-cd1b-4562-a539-0d765aa2a3f8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:27.822996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b4422da3-cd1b-4562-a539-0d765aa2a3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.834337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4662-d8a0-44bb-b727-10191a40667c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.893236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1032/2074] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:27.894155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4422da3-cd1b-4562-a539-0d765aa2a3f8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.895479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b4422da3-cd1b-4562-a539-0d765aa2a3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.912034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4422da3-cd1b-4562-a539-0d765aa2a3f8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.912240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad18839-988b-40cf-8c7a-93ff40d9643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.912240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18839-988b-40cf-8c7a-93ff40d9643f admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.912240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18839-988b-40cf-8c7a-93ff40d9643f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.912240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18839-988b-40cf-8c7a-93ff40d9643f admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.912533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad18839-988b-40cf-8c7a-93ff40d9643f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.912533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad18839-988b-40cf-8c7a-93ff40d9643f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.913689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae75a9-d3b5-4faa-8a77-9234d0ceff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.914300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae75a9-d3b5-4faa-8a77-9234d0ceff13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.914581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae75a9-d3b5-4faa-8a77-9234d0ceff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.914851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae75a9-d3b5-4faa-8a77-9234d0ceff13 admin admin] PATH_INFO: `/v3/projects/fff3c8c828ae45ea8879878f62180411/users/896a6b5f21fe481e87d3ffb6df5e42bc/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.926062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1043/2075] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:27.926062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32b53e-5a63-4ee9-8740-2248ce5c68fe None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.926062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32b53e-5a63-4ee9-8740-2248ce5c68fe None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.926062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32b53e-5a63-4ee9-8740-2248ce5c68fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.933093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae75a9-d3b5-4faa-8a77-9234d0ceff13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff3c8c828ae45ea8879878f62180411, user_id=896a6b5f21fe481e87d3ffb6df5e42bc, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.935735 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae75a9-d3b5-4faa-8a77-9234d0ceff13 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.949217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1033/2076] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:27 2022] PUT /identity/v3/projects/fff3c8c828ae45ea8879878f62180411/users/896a6b5f21fe481e87d3ffb6df5e42bc/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:27.950048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae75a9-d3b5-4faa-8a77-9234d0ceff13 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.951995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-aaae75a9-d3b5-4faa-8a77-9234d0ceff13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.953069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-ad32b53e-5a63-4ee9-8740-2248ce5c68fe None None] MFA Rules not processed for user `b2aa64efbefa4e64ab53a80d0a75bc93`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:27.954281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ad32b53e-5a63-4ee9-8740-2248ce5c68fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.989517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:28.017802 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae75a9-d3b5-4faa-8a77-9234d0ceff13 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.022509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.023145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.023407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.023512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1044/2077] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:28.023699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] PATH_INFO: `/v3/users/d4e4f2f7e91041deb6992d75fb599d50` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.024757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774cb56-4be4-4028-977d-79398577350c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.024933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e4f2f7e91041deb6992d75fb599d50)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.025044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774cb56-4be4-4028-977d-79398577350c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.025288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774cb56-4be4-4028-977d-79398577350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.027549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.045938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8774cb56-4be4-4028-977d-79398577350c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:28.047057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8774cb56-4be4-4028-977d-79398577350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.051661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:28.060139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1045/2078] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:28.061479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774cb56-4be4-4028-977d-79398577350c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.063396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8774cb56-4be4-4028-977d-79398577350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.075976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774cb56-4be4-4028-977d-79398577350c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.078720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e4f2f7e91041deb6992d75fb599d50'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:28.080538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc1bf6-423a-46f3-ac6e-14383b9fa3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.081180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc1bf6-423a-46f3-ac6e-14383b9fa3ac admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.081456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc1bf6-423a-46f3-ac6e-14383b9fa3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.081723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc1bf6-423a-46f3-ac6e-14383b9fa3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.082361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc1bf6-423a-46f3-ac6e-14383b9fa3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.084211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc1bf6-423a-46f3-ac6e-14383b9fa3ac admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.086174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e4f2f7e91041deb6992d75fb599d50'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:28.086820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e4f2f7e91041deb6992d75fb599d50'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:28.087435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e4f2f7e91041deb6992d75fb599d50'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:28.095246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e4f2f7e91041deb6992d75fb599d50'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:28.095480 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1046/2079] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:28.096426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc1bf6-423a-46f3-ac6e-14383b9fa3ac admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.099877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-76dc1bf6-423a-46f3-ac6e-14383b9fa3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.113206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc1bf6-423a-46f3-ac6e-14383b9fa3ac admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.114826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1034/2080] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:27 2022] DELETE /identity/v3/users/d4e4f2f7e91041deb6992d75fb599d50 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:28.115635 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.116975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.185613 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f82da-974e-42cc-8ce8-bab2778db0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.186687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f82da-974e-42cc-8ce8-bab2778db0fd admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.187107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f82da-974e-42cc-8ce8-bab2778db0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.187626 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f82da-974e-42cc-8ce8-bab2778db0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.188253 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f82da-974e-42cc-8ce8-bab2778db0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.189870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f82da-974e-42cc-8ce8-bab2778db0fd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.206592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1047/2081] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:28.208035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f82da-974e-42cc-8ce8-bab2778db0fd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.209920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fa9f82da-974e-42cc-8ce8-bab2778db0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.227086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf9275-e355-4a63-8c08-19dc164cc87c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.227973 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f82da-974e-42cc-8ce8-bab2778db0fd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.231864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c002e-26cf-400a-81bd-f7011252f0ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79efccae1afa46e78c25f617bf2dd9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.232545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c002e-26cf-400a-81bd-f7011252f0ca service glance] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.233240 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c002e-26cf-400a-81bd-f7011252f0ca service glance] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.233585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c002e-26cf-400a-81bd-f7011252f0ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.236369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c06c002e-26cf-400a-81bd-f7011252f0ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.236752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e74d47-b334-41b7-aba0-4a4092fad418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.237848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e74d47-b334-41b7-aba0-4a4092fad418 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.238276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e74d47-b334-41b7-aba0-4a4092fad418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.238821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e74d47-b334-41b7-aba0-4a4092fad418 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.239980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e74d47-b334-41b7-aba0-4a4092fad418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:28.240448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e74d47-b334-41b7-aba0-4a4092fad418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.242885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e74d47-b334-41b7-aba0-4a4092fad418 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.262097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1048/2082] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:28.262957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e74d47-b334-41b7-aba0-4a4092fad418 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.265300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-57e74d47-b334-41b7-aba0-4a4092fad418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.281589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e74d47-b334-41b7-aba0-4a4092fad418 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.288014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8d53e-bba1-4468-ba65-ee5a4d29270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.288653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8d53e-bba1-4468-ba65-ee5a4d29270e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.288947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8d53e-bba1-4468-ba65-ee5a4d29270e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.292316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8d53e-bba1-4468-ba65-ee5a4d29270e admin admin] PATH_INFO: `/v3/projects/3214e77a6af34973b1f3ad86cd0ff64c/users/406e076b6e2d4abfa1de3de5c8b52356/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.304874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c002e-26cf-400a-81bd-f7011252f0ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.306519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c002e-26cf-400a-81bd-f7011252f0ca service glance] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.317481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1035/2083] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:28.318314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c002e-26cf-400a-81bd-f7011252f0ca service glance] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.331459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c002e-26cf-400a-81bd-f7011252f0ca service glance] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.337592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f4aa4-2ceb-4fdf-b2ba-b21ace202fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.338942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8d53e-bba1-4468-ba65-ee5a4d29270e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3214e77a6af34973b1f3ad86cd0ff64c, user_id=406e076b6e2d4abfa1de3de5c8b52356, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.339123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4aa4-2ceb-4fdf-b2ba-b21ace202fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.339380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4aa4-2ceb-4fdf-b2ba-b21ace202fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.339856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4aa4-2ceb-4fdf-b2ba-b21ace202fcd admin admin] PATH_INFO: `/v3/projects/fff3c8c828ae45ea8879878f62180411/users/896a6b5f21fe481e87d3ffb6df5e42bc/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.342032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f4aa4-2ceb-4fdf-b2ba-b21ace202fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff3c8c828ae45ea8879878f62180411, user_id=896a6b5f21fe481e87d3ffb6df5e42bc, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.344965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8d53e-bba1-4468-ba65-ee5a4d29270e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.345084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f4aa4-2ceb-4fdf-b2ba-b21ace202fcd admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.359757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1036/2084] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:28 2022] PUT /identity/v3/projects/fff3c8c828ae45ea8879878f62180411/users/896a6b5f21fe481e87d3ffb6df5e42bc/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:28.368540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f4aa4-2ceb-4fdf-b2ba-b21ace202fcd admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.371818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1049/2085] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:28 2022] PUT /identity/v3/projects/3214e77a6af34973b1f3ad86cd0ff64c/users/406e076b6e2d4abfa1de3de5c8b52356/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:28.373854 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b840b99-15b3-4045-9de5-79a3eabf3f81 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.374140 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b840b99-15b3-4045-9de5-79a3eabf3f81 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.375094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b840b99-15b3-4045-9de5-79a3eabf3f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.403555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:28.424159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6b840b99-15b3-4045-9de5-79a3eabf3f81 None None] MFA Rules not processed for user `896a6b5f21fe481e87d3ffb6df5e42bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:28.425839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6b840b99-15b3-4045-9de5-79a3eabf3f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.465861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f4aa4-2ceb-4fdf-b2ba-b21ace202fcd admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.536489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76380226-3f9b-4bc7-9ec1-82ad0005a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.537308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76380226-3f9b-4bc7-9ec1-82ad0005a9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.537587 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76380226-3f9b-4bc7-9ec1-82ad0005a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.537856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76380226-3f9b-4bc7-9ec1-82ad0005a9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.538831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76380226-3f9b-4bc7-9ec1-82ad0005a9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.540849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76380226-3f9b-4bc7-9ec1-82ad0005a9e8 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.542031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:28.552227 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1050/2086] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:28.553669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f135c-e072-472d-9f74-7794b7e4988a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.553880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f135c-e072-472d-9f74-7794b7e4988a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.554155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f135c-e072-472d-9f74-7794b7e4988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.579303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1037/2087] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:28 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:28.580536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76380226-3f9b-4bc7-9ec1-82ad0005a9e8 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.582613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-76380226-3f9b-4bc7-9ec1-82ad0005a9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.594267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-037f135c-e072-472d-9f74-7794b7e4988a None None] MFA Rules not processed for user `406e076b6e2d4abfa1de3de5c8b52356`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:28.595690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-037f135c-e072-472d-9f74-7794b7e4988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.665098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76380226-3f9b-4bc7-9ec1-82ad0005a9e8 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.671205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.671857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.672132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.672402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] PATH_INFO: `/v3/projects/7ac302db0de34d1f8936ff3090cbef08` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.673593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac302db0de34d1f8936ff3090cbef08)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.675523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.701399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1051/2088] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:28.703007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f135c-e072-472d-9f74-7794b7e4988a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.704923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-037f135c-e072-472d-9f74-7794b7e4988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.781359 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac302db0de34d1f8936ff3090cbef08', 'request_id': 'req-162b2576-0c82-4fda-af8c-5b5d91ecabe4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:28.787046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f135c-e072-472d-9f74-7794b7e4988a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.787790 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:28.790366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac302db0de34d1f8936ff3090cbef08', 'request_id': 'req-162b2576-0c82-4fda-af8c-5b5d91ecabe4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:28.800027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac302db0de34d1f8936ff3090cbef08', 'request_id': 'req-162b2576-0c82-4fda-af8c-5b5d91ecabe4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:28.818113 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] The token cache is being invalidate because project 7ac302db0de34d1f8936ff3090cbef08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:28.818550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:28.819327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:28.825442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1038/2089] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:28 2022] DELETE /identity/v3/projects/7ac302db0de34d1f8936ff3090cbef08 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:28.826992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.829725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.876761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aaf0d-3e0d-4b6b-989a-e1587a6c4477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.877436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aaf0d-3e0d-4b6b-989a-e1587a6c4477 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.877716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aaf0d-3e0d-4b6b-989a-e1587a6c4477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.877987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aaf0d-3e0d-4b6b-989a-e1587a6c4477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.879785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0b7aaf0d-3e0d-4b6b-989a-e1587a6c4477 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.928936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b2576-0c82-4fda-af8c-5b5d91ecabe4 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.935809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841ee6b-4306-4a6d-ad03-3449c0dfa9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.936612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841ee6b-4306-4a6d-ad03-3449c0dfa9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.937041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841ee6b-4306-4a6d-ad03-3449c0dfa9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.937376 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841ee6b-4306-4a6d-ad03-3449c0dfa9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.938160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841ee6b-4306-4a6d-ad03-3449c0dfa9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.941334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841ee6b-4306-4a6d-ad03-3449c0dfa9f2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.960975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:28.984331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1039/2090] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:28 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:28.984331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841ee6b-4306-4a6d-ad03-3449c0dfa9f2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.984331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e841ee6b-4306-4a6d-ad03-3449c0dfa9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.984561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7aaf0d-3e0d-4b6b-989a-e1587a6c4477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.984561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7aaf0d-3e0d-4b6b-989a-e1587a6c4477 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.989151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841ee6b-4306-4a6d-ad03-3449c0dfa9f2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.995760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d9038-30c8-4cbb-8412-4f1f4484c5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.996835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d9038-30c8-4cbb-8412-4f1f4484c5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.997298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d9038-30c8-4cbb-8412-4f1f4484c5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.997747 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d9038-30c8-4cbb-8412-4f1f4484c5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.998725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d9038-30c8-4cbb-8412-4f1f4484c5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.000796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d9038-30c8-4cbb-8412-4f1f4484c5d7 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.019439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1052/2091] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:29.021067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c9b3-09b2-47be-b610-2977329ad49d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.021361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c9b3-09b2-47be-b610-2977329ad49d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.021688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c9b3-09b2-47be-b610-2977329ad49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.056177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1040/2092] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:28 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:29.056177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d9038-30c8-4cbb-8412-4f1f4484c5d7 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.072360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8635c9b3-09b2-47be-b610-2977329ad49d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:29.074812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8635c9b3-09b2-47be-b610-2977329ad49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.151975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d9038-30c8-4cbb-8412-4f1f4484c5d7 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.160043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2172309-bcb3-4630-b616-6e1dfc09f05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.160850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2172309-bcb3-4630-b616-6e1dfc09f05c admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.161502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2172309-bcb3-4630-b616-6e1dfc09f05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.162411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2172309-bcb3-4630-b616-6e1dfc09f05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.162959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2172309-bcb3-4630-b616-6e1dfc09f05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.164711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2172309-bcb3-4630-b616-6e1dfc09f05c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.179155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1041/2093] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:29.180226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2172309-bcb3-4630-b616-6e1dfc09f05c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.184815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1053/2094] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:29.185991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635c9b3-09b2-47be-b610-2977329ad49d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.187902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8635c9b3-09b2-47be-b610-2977329ad49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.192665 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2172309-bcb3-4630-b616-6e1dfc09f05c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.201663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ab849-4047-41e8-b2eb-716695af3eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.202690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab849-4047-41e8-b2eb-716695af3eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.203192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab849-4047-41e8-b2eb-716695af3eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.203929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab849-4047-41e8-b2eb-716695af3eaf admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.204716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ab849-4047-41e8-b2eb-716695af3eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.206782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ab849-4047-41e8-b2eb-716695af3eaf admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.235961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1042/2095] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:29 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:29.235961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffb878-da09-4fcd-803f-0e9c666eb864 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.235961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffb878-da09-4fcd-803f-0e9c666eb864 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.235961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffb878-da09-4fcd-803f-0e9c666eb864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.257961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-57ffb878-da09-4fcd-803f-0e9c666eb864 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:29.259194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-57ffb878-da09-4fcd-803f-0e9c666eb864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.264990 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635c9b3-09b2-47be-b610-2977329ad49d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.268602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77867d8-e6ee-4e6a-8231-16c0f240af2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.269325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1043/2096] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:29.269454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77867d8-e6ee-4e6a-8231-16c0f240af2e service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.269544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77867d8-e6ee-4e6a-8231-16c0f240af2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.269807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77867d8-e6ee-4e6a-8231-16c0f240af2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.271847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e77867d8-e6ee-4e6a-8231-16c0f240af2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.273224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffb878-da09-4fcd-803f-0e9c666eb864 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.283398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffb878-da09-4fcd-803f-0e9c666eb864 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.290282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4c70a-21d5-43ac-a230-c7c20fb37282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.290881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c70a-21d5-43ac-a230-c7c20fb37282 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.291153 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c70a-21d5-43ac-a230-c7c20fb37282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.291483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c70a-21d5-43ac-a230-c7c20fb37282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.292220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4c70a-21d5-43ac-a230-c7c20fb37282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.293845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4c70a-21d5-43ac-a230-c7c20fb37282 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.308341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1044/2097] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:29.308341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4c70a-21d5-43ac-a230-c7c20fb37282 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.316784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4c70a-21d5-43ac-a230-c7c20fb37282 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.322683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89185d-2d0e-4a7f-b104-12ac3d0734e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.323225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89185d-2d0e-4a7f-b104-12ac3d0734e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.323505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89185d-2d0e-4a7f-b104-12ac3d0734e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.323795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89185d-2d0e-4a7f-b104-12ac3d0734e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.324440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89185d-2d0e-4a7f-b104-12ac3d0734e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.326081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89185d-2d0e-4a7f-b104-12ac3d0734e3 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.332288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=2,keystone:SELECT=90,keystone:INSERT=8 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:29.339424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1045/2098] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:29.340445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89185d-2d0e-4a7f-b104-12ac3d0734e3 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.355067 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89185d-2d0e-4a7f-b104-12ac3d0734e3 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.361139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae21cd-9677-4545-9ffd-be79e01a037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.361603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77867d8-e6ee-4e6a-8231-16c0f240af2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.362271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae21cd-9677-4545-9ffd-be79e01a037b admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.362694 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae21cd-9677-4545-9ffd-be79e01a037b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.363044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77867d8-e6ee-4e6a-8231-16c0f240af2e service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.363259 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae21cd-9677-4545-9ffd-be79e01a037b admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.364045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae21cd-9677-4545-9ffd-be79e01a037b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:29.364496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae21cd-9677-4545-9ffd-be79e01a037b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.367036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae21cd-9677-4545-9ffd-be79e01a037b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.373559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1054/2099] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:29.374421 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77867d8-e6ee-4e6a-8231-16c0f240af2e service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.388537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1046/2100] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:29.390579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae21cd-9677-4545-9ffd-be79e01a037b admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.412201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae21cd-9677-4545-9ffd-be79e01a037b admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.412751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77867d8-e6ee-4e6a-8231-16c0f240af2e service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.425400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92998-f58c-4b52-ab66-4b8a532960e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.426884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92998-f58c-4b52-ab66-4b8a532960e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.427152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92998-f58c-4b52-ab66-4b8a532960e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.427418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92998-f58c-4b52-ab66-4b8a532960e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.428903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af92998-f58c-4b52-ab66-4b8a532960e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.431130 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af92998-f58c-4b52-ab66-4b8a532960e4 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.436908 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee05ab-ffdd-4606-bad1-fc5976f34ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.439091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee05ab-ffdd-4606-bad1-fc5976f34ace admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.441268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee05ab-ffdd-4606-bad1-fc5976f34ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.442383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee05ab-ffdd-4606-bad1-fc5976f34ace admin admin] PATH_INFO: `/v3/projects/9a01df843f8c4f7bb6554bcb946d8d9e/users/cdca9cfcac7441e0ad52988ca0e78bc6/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.447140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1047/2101] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:29.447140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92998-f58c-4b52-ab66-4b8a532960e4 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.461047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92998-f58c-4b52-ab66-4b8a532960e4 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.467137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee05ab-ffdd-4606-bad1-fc5976f34ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a01df843f8c4f7bb6554bcb946d8d9e, user_id=cdca9cfcac7441e0ad52988ca0e78bc6, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.468419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89b8f1-9998-4f47-ad86-5219d303d864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.469218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b8f1-9998-4f47-ad86-5219d303d864 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.469499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b8f1-9998-4f47-ad86-5219d303d864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.469766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b8f1-9998-4f47-ad86-5219d303d864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.470867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee05ab-ffdd-4606-bad1-fc5976f34ace admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.470987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89b8f1-9998-4f47-ad86-5219d303d864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.473072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89b8f1-9998-4f47-ad86-5219d303d864 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.501404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1055/2102] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:29 2022] PUT /identity/v3/projects/9a01df843f8c4f7bb6554bcb946d8d9e/users/cdca9cfcac7441e0ad52988ca0e78bc6/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:29.503926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee05ab-ffdd-4606-bad1-fc5976f34ace admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.536494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1048/2103] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:29 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:29.536494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce7b03-6f72-4cec-baca-d0e34b289eea None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.536494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce7b03-6f72-4cec-baca-d0e34b289eea None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.536494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce7b03-6f72-4cec-baca-d0e34b289eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.558820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:29.603398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee05ab-ffdd-4606-bad1-fc5976f34ace admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.613114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d6ce7b03-6f72-4cec-baca-d0e34b289eea None None] MFA Rules not processed for user `cdca9cfcac7441e0ad52988ca0e78bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:29.615196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d6ce7b03-6f72-4cec-baca-d0e34b289eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.711250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5392-0c68-4666-8599-2c22712584da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.711693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5392-0c68-4666-8599-2c22712584da admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.712036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5392-0c68-4666-8599-2c22712584da admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.712290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5392-0c68-4666-8599-2c22712584da admin admin] PATH_INFO: `/v3/projects/54c3f68023b245c0b9b6100e1f25cc74/users/16e2a957f0ff437e9a5a055c7012a50c/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.733901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc5392-0c68-4666-8599-2c22712584da admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c3f68023b245c0b9b6100e1f25cc74, user_id=16e2a957f0ff437e9a5a055c7012a50c, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.736779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc5392-0c68-4666-8599-2c22712584da admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.759170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1056/2104] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:29 2022] PUT /identity/v3/projects/54c3f68023b245c0b9b6100e1f25cc74/users/16e2a957f0ff437e9a5a055c7012a50c/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:29.761039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5392-0c68-4666-8599-2c22712584da admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.771877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1049/2105] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:29.771877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea5698-bb7b-4604-b45b-0eb3cad19f39 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.771877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea5698-bb7b-4604-b45b-0eb3cad19f39 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.771877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea5698-bb7b-4604-b45b-0eb3cad19f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.869575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-09ea5698-bb7b-4604-b45b-0eb3cad19f39 None None] MFA Rules not processed for user `16e2a957f0ff437e9a5a055c7012a50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:29.871597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-09ea5698-bb7b-4604-b45b-0eb3cad19f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.932786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5392-0c68-4666-8599-2c22712584da admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.943570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28ef85-b769-4796-899f-ebcead66afc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.944481 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28ef85-b769-4796-899f-ebcead66afc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.945099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28ef85-b769-4796-899f-ebcead66afc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.945458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28ef85-b769-4796-899f-ebcead66afc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.946287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28ef85-b769-4796-899f-ebcead66afc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.950031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28ef85-b769-4796-899f-ebcead66afc8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.000561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1057/2106] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:29 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:30.001642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28ef85-b769-4796-899f-ebcead66afc8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.010357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5f28ef85-b769-4796-899f-ebcead66afc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:30.040265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1050/2107] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:30.043895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea5698-bb7b-4604-b45b-0eb3cad19f39 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.086903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea5698-bb7b-4604-b45b-0eb3cad19f39 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.108458 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdac022-f47a-4180-be2f-12a7988459e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.109155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdac022-f47a-4180-be2f-12a7988459e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.109485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdac022-f47a-4180-be2f-12a7988459e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.109760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdac022-f47a-4180-be2f-12a7988459e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.110419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdac022-f47a-4180-be2f-12a7988459e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.113972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdac022-f47a-4180-be2f-12a7988459e9 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.120926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:30.129697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28ef85-b769-4796-899f-ebcead66afc8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.129970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1051/2108] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:30.134222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdac022-f47a-4180-be2f-12a7988459e9 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.142613 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657726ec-3fde-4430-ba93-ee52e2779d97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.143304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657726ec-3fde-4430-ba93-ee52e2779d97 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.143617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657726ec-3fde-4430-ba93-ee52e2779d97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.143887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657726ec-3fde-4430-ba93-ee52e2779d97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.151872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdac022-f47a-4180-be2f-12a7988459e9 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.165924 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211d38-b5b8-4081-a489-6bc6994d819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.167892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211d38-b5b8-4081-a489-6bc6994d819c admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.168322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211d38-b5b8-4081-a489-6bc6994d819c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.168859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211d38-b5b8-4081-a489-6bc6994d819c admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.169597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211d38-b5b8-4081-a489-6bc6994d819c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.172178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211d38-b5b8-4081-a489-6bc6994d819c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.211099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:30.224957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1052/2109] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:30 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:30.226026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211d38-b5b8-4081-a489-6bc6994d819c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.230034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657726ec-3fde-4430-ba93-ee52e2779d97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.232001 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657726ec-3fde-4430-ba93-ee52e2779d97 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.243930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1058/2110] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:30.257712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657726ec-3fde-4430-ba93-ee52e2779d97 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.283610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657726ec-3fde-4430-ba93-ee52e2779d97 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.344982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211d38-b5b8-4081-a489-6bc6994d819c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.356459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221bc1d-c61a-4914-8364-068f92198073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.357610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221bc1d-c61a-4914-8364-068f92198073 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.358133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221bc1d-c61a-4914-8364-068f92198073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.358589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221bc1d-c61a-4914-8364-068f92198073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.359750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221bc1d-c61a-4914-8364-068f92198073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.363788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221bc1d-c61a-4914-8364-068f92198073 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.386526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1053/2111] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:30.389959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0fe2-5c79-4cb6-9820-5b7caf79f7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.390601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0fe2-5c79-4cb6-9820-5b7caf79f7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.390877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0fe2-5c79-4cb6-9820-5b7caf79f7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.391144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0fe2-5c79-4cb6-9820-5b7caf79f7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.391835 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e0fe2-5c79-4cb6-9820-5b7caf79f7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.393492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221bc1d-c61a-4914-8364-068f92198073 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.394248 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e0fe2-5c79-4cb6-9820-5b7caf79f7c3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.422235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1059/2112] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:30 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:30.426219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0fe2-5c79-4cb6-9820-5b7caf79f7c3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.434197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221bc1d-c61a-4914-8364-068f92198073 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.439257 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0fe2-5c79-4cb6-9820-5b7caf79f7c3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.449308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cf151-ab16-41d3-bb38-df5ed548505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.450008 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf151-ab16-41d3-bb38-df5ed548505a admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.450269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf151-ab16-41d3-bb38-df5ed548505a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.451272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf151-ab16-41d3-bb38-df5ed548505a admin admin] PATH_INFO: `/v3/projects/530707cfa1d54a2abfa7802331e3e1f8/users/b5f7c1949d54426085b42cc44daab466/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.452568 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbb0a5-8f93-42c8-b26c-75be89e9678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.453195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbb0a5-8f93-42c8-b26c-75be89e9678d admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.453536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbb0a5-8f93-42c8-b26c-75be89e9678d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.453834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbb0a5-8f93-42c8-b26c-75be89e9678d admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.454565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbb0a5-8f93-42c8-b26c-75be89e9678d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.457715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbb0a5-8f93-42c8-b26c-75be89e9678d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.477148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cf151-ab16-41d3-bb38-df5ed548505a admin admin] RBAC: Authorizing `identity:create_grant(project_id=530707cfa1d54a2abfa7802331e3e1f8, user_id=b5f7c1949d54426085b42cc44daab466, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.480868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cf151-ab16-41d3-bb38-df5ed548505a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.482774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1060/2113] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:30.487007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbb0a5-8f93-42c8-b26c-75be89e9678d admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.499726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbb0a5-8f93-42c8-b26c-75be89e9678d admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.504707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1054/2114] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:30 2022] PUT /identity/v3/projects/530707cfa1d54a2abfa7802331e3e1f8/users/b5f7c1949d54426085b42cc44daab466/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:30.515243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868980d-154f-4c2e-ab3a-e4c8cdcc0d5b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.515633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868980d-154f-4c2e-ab3a-e4c8cdcc0d5b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.516374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868980d-154f-4c2e-ab3a-e4c8cdcc0d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.553142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-0868980d-154f-4c2e-ab3a-e4c8cdcc0d5b None None] MFA Rules not processed for user `b5f7c1949d54426085b42cc44daab466`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:30.554496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0868980d-154f-4c2e-ab3a-e4c8cdcc0d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:30.590151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bbcfb-054d-4f5a-b9e5-a0d9843c6214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.590799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bbcfb-054d-4f5a-b9e5-a0d9843c6214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.591178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bbcfb-054d-4f5a-b9e5-a0d9843c6214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.591453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bbcfb-054d-4f5a-b9e5-a0d9843c6214 admin admin] PATH_INFO: `/v3/projects/0a8388741a4f457791362dcb823dea1a/users/d5ffd76b44fd4c8089c01ecede30dbab/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.608084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bbcfb-054d-4f5a-b9e5-a0d9843c6214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8388741a4f457791362dcb823dea1a, user_id=d5ffd76b44fd4c8089c01ecede30dbab, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.614437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bbcfb-054d-4f5a-b9e5-a0d9843c6214 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.630578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1061/2115] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:30 2022] PUT /identity/v3/projects/0a8388741a4f457791362dcb823dea1a/users/d5ffd76b44fd4c8089c01ecede30dbab/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:30.634685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bbcfb-054d-4f5a-b9e5-a0d9843c6214 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.636670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1055/2116] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:30.639860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:30.641118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868980d-154f-4c2e-ab3a-e4c8cdcc0d5b None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.659389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868980d-154f-4c2e-ab3a-e4c8cdcc0d5b None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.736707 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bbcfb-054d-4f5a-b9e5-a0d9843c6214 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.742172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a6e2e-dc7a-48f2-b042-c02af6523ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.742866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a6e2e-dc7a-48f2-b042-c02af6523ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.743146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a6e2e-dc7a-48f2-b042-c02af6523ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.743549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a6e2e-dc7a-48f2-b042-c02af6523ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.744197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a6e2e-dc7a-48f2-b042-c02af6523ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.746229 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a6e2e-dc7a-48f2-b042-c02af6523ee5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.746905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b0da-241d-44ce-af4d-5e17db74ff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.749149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b0da-241d-44ce-af4d-5e17db74ff07 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.749149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b0da-241d-44ce-af4d-5e17db74ff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.750218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b0da-241d-44ce-af4d-5e17db74ff07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.751430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b0da-241d-44ce-af4d-5e17db74ff07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.753622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b0da-241d-44ce-af4d-5e17db74ff07 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.757796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1062/2117] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:30.761202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:30.762196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a6e2e-dc7a-48f2-b042-c02af6523ee5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.773256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a6e2e-dc7a-48f2-b042-c02af6523ee5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.778660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338e65-d620-4fd1-815c-1becdad6739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.779440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338e65-d620-4fd1-815c-1becdad6739e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.779896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338e65-d620-4fd1-815c-1becdad6739e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.780169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338e65-d620-4fd1-815c-1becdad6739e admin admin] PATH_INFO: `/v3/projects/0a8388741a4f457791362dcb823dea1a/users/d5ffd76b44fd4c8089c01ecede30dbab/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.782093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed338e65-d620-4fd1-815c-1becdad6739e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8388741a4f457791362dcb823dea1a, user_id=d5ffd76b44fd4c8089c01ecede30dbab, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.784764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed338e65-d620-4fd1-815c-1becdad6739e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.785923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1056/2118] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:30 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:30.789832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b0da-241d-44ce-af4d-5e17db74ff07 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.796317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1063/2119] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:30 2022] PUT /identity/v3/projects/0a8388741a4f457791362dcb823dea1a/users/d5ffd76b44fd4c8089c01ecede30dbab/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:30.806612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbcddf-2535-4bd6-b642-b26aaed2fc54 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.807426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbcddf-2535-4bd6-b642-b26aaed2fc54 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.807729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbcddf-2535-4bd6-b642-b26aaed2fc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.837026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1bdbcddf-2535-4bd6-b642-b26aaed2fc54 None None] MFA Rules not processed for user `d5ffd76b44fd4c8089c01ecede30dbab`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:30.838734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1bdbcddf-2535-4bd6-b642-b26aaed2fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:30.866053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b0da-241d-44ce-af4d-5e17db74ff07 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.934853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1064/2120] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:30.949497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbcddf-2535-4bd6-b642-b26aaed2fc54 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.972101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3bd8-b00c-4398-8fe2-7041566a87b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.972800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3bd8-b00c-4398-8fe2-7041566a87b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.973312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3bd8-b00c-4398-8fe2-7041566a87b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.973515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3bd8-b00c-4398-8fe2-7041566a87b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.974101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a3bd8-b00c-4398-8fe2-7041566a87b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.976159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a3bd8-b00c-4398-8fe2-7041566a87b1 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.002979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1057/2121] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:30 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:31.009920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3bd8-b00c-4398-8fe2-7041566a87b1 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:31.021131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbcddf-2535-4bd6-b642-b26aaed2fc54 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:31.025937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced02535-d0e1-49d8-bca1-ba224599678c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:31.026821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced02535-d0e1-49d8-bca1-ba224599678c service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.027205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced02535-d0e1-49d8-bca1-ba224599678c service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.027561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced02535-d0e1-49d8-bca1-ba224599678c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.034832 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3bd8-b00c-4398-8fe2-7041566a87b1 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:31.039542 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced02535-d0e1-49d8-bca1-ba224599678c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.042190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced02535-d0e1-49d8-bca1-ba224599678c service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.042313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bd827-f11a-4bb3-a526-51a097adde73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:31.042922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bd827-f11a-4bb3-a526-51a097adde73 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.043202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bd827-f11a-4bb3-a526-51a097adde73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.043480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bd827-f11a-4bb3-a526-51a097adde73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.044124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bd827-f11a-4bb3-a526-51a097adde73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.046025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bd827-f11a-4bb3-a526-51a097adde73 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.055579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1065/2122] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:31.073802 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1058/2123] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:31.078155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced02535-d0e1-49d8-bca1-ba224599678c service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:31.093057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced02535-d0e1-49d8-bca1-ba224599678c service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:31.098867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64ae61-8fd0-4660-85af-778ac0e424ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:31.099750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64ae61-8fd0-4660-85af-778ac0e424ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.100045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64ae61-8fd0-4660-85af-778ac0e424ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.100454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64ae61-8fd0-4660-85af-778ac0e424ef admin admin] PATH_INFO: `/v3/projects/16c15107ddda4867928f0f96d2f503a6/users/408268cc1f1742e1a1b93240e0dc6a13/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.125179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:31.131880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bd827-f11a-4bb3-a526-51a097adde73 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:31.135578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64ae61-8fd0-4660-85af-778ac0e424ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c15107ddda4867928f0f96d2f503a6, user_id=408268cc1f1742e1a1b93240e0dc6a13, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.139374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64ae61-8fd0-4660-85af-778ac0e424ef admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.146793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bd827-f11a-4bb3-a526-51a097adde73 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:31.151765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda64a0-a390-4db5-b970-6d58bcacc5dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:31.152612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda64a0-a390-4db5-b970-6d58bcacc5dd service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.155338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda64a0-a390-4db5-b970-6d58bcacc5dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.159264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda64a0-a390-4db5-b970-6d58bcacc5dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.159264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8dda64a0-a390-4db5-b970-6d58bcacc5dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:31.163870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1066/2124] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:31 2022] PUT /identity/v3/projects/16c15107ddda4867928f0f96d2f503a6/users/408268cc1f1742e1a1b93240e0dc6a13/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:31.168190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64ae61-8fd0-4660-85af-778ac0e424ef admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:31.242969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64ae61-8fd0-4660-85af-778ac0e424ef admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:31.244026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda64a0-a390-4db5-b970-6d58bcacc5dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.245714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda64a0-a390-4db5-b970-6d58bcacc5dd service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.248374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470f086-d216-49e1-a449-fc772e144de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:31.249200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470f086-d216-49e1-a449-fc772e144de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.249482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470f086-d216-49e1-a449-fc772e144de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.249753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470f086-d216-49e1-a449-fc772e144de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.250440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470f086-d216-49e1-a449-fc772e144de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.252111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470f086-d216-49e1-a449-fc772e144de5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.264971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1059/2125] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:31.274007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1067/2126] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:31.280025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda64a0-a390-4db5-b970-6d58bcacc5dd service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:31.295308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda64a0-a390-4db5-b970-6d58bcacc5dd service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:31.300146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3c831-1380-4f53-83f4-fe9fb5f44c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:31.301107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3c831-1380-4f53-83f4-fe9fb5f44c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.301388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3c831-1380-4f53-83f4-fe9fb5f44c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.301660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3c831-1380-4f53-83f4-fe9fb5f44c3d admin admin] PATH_INFO: `/v3/projects/16c15107ddda4867928f0f96d2f503a6/users/408268cc1f1742e1a1b93240e0dc6a13/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.303808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3c831-1380-4f53-83f4-fe9fb5f44c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c15107ddda4867928f0f96d2f503a6, user_id=408268cc1f1742e1a1b93240e0dc6a13, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.306606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3c831-1380-4f53-83f4-fe9fb5f44c3d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.315825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:31.336524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1060/2127] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:31 2022] PUT /identity/v3/projects/16c15107ddda4867928f0f96d2f503a6/users/408268cc1f1742e1a1b93240e0dc6a13/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:31.359848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5671667-3daa-4f4f-9a96-c14d93cbf37f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.360233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5671667-3daa-4f4f-9a96-c14d93cbf37f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.360402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5671667-3daa-4f4f-9a96-c14d93cbf37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.400496 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b5671667-3daa-4f4f-9a96-c14d93cbf37f None None] MFA Rules not processed for user `408268cc1f1742e1a1b93240e0dc6a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:31.400496 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b5671667-3daa-4f4f-9a96-c14d93cbf37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:31.512080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1068/2128] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:31.543232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3c831-1380-4f53-83f4-fe9fb5f44c3d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:31.622426 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3c831-1380-4f53-83f4-fe9fb5f44c3d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:31.627602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945f29c-bb35-4810-bcc2-da7f83887a0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:31.628711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f29c-bb35-4810-bcc2-da7f83887a0f service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.629201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f29c-bb35-4810-bcc2-da7f83887a0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.629475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945f29c-bb35-4810-bcc2-da7f83887a0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.641509 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945f29c-bb35-4810-bcc2-da7f83887a0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.643542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945f29c-bb35-4810-bcc2-da7f83887a0f service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.667136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1061/2129] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:33.533153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5671667-3daa-4f4f-9a96-c14d93cbf37f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.597542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945f29c-bb35-4810-bcc2-da7f83887a0f service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.610269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5671667-3daa-4f4f-9a96-c14d93cbf37f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.617806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.618547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.618886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.619286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] PATH_INFO: `/v3/users/b5f7c1949d54426085b42cc44daab466` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.620869 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f7c1949d54426085b42cc44daab466)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.622889 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.639003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:33.680000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945f29c-bb35-4810-bcc2-da7f83887a0f service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.684052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f7c1949d54426085b42cc44daab466'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.684745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.685552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.685896 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.686238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] PATH_INFO: `/v3/users/cdca9cfcac7441e0ad52988ca0e78bc6` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.687576 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdca9cfcac7441e0ad52988ca0e78bc6)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.689979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.693533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f7c1949d54426085b42cc44daab466'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.694219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f7c1949d54426085b42cc44daab466'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.694817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f7c1949d54426085b42cc44daab466'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.709839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e5d473b3-32e7-4090-9419-6e5c49b6c7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f7c1949d54426085b42cc44daab466'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.735987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1069/2130] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:33 2022] DELETE /identity/v3/users/b5f7c1949d54426085b42cc44daab466 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:33.740572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d5055-b5a4-4221-b6fe-f50520fe136a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.740911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d5055-b5a4-4221-b6fe-f50520fe136a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.741183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d5055-b5a4-4221-b6fe-f50520fe136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.767247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d10d5055-b5a4-4221-b6fe-f50520fe136a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:33.768515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d10d5055-b5a4-4221-b6fe-f50520fe136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:33.772112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdca9cfcac7441e0ad52988ca0e78bc6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.789696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdca9cfcac7441e0ad52988ca0e78bc6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.790982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdca9cfcac7441e0ad52988ca0e78bc6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.791915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdca9cfcac7441e0ad52988ca0e78bc6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.806085 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4349418e-417f-42eb-82fb-244b6b0796fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdca9cfcac7441e0ad52988ca0e78bc6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.837370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1062/2131] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:33 2022] DELETE /identity/v3/users/cdca9cfcac7441e0ad52988ca0e78bc6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:33.842737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d627aa-0c3a-4a9f-931e-82e0b929b864 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.843428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d627aa-0c3a-4a9f-931e-82e0b929b864 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.843808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d627aa-0c3a-4a9f-931e-82e0b929b864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.875309 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-e0d627aa-0c3a-4a9f-931e-82e0b929b864 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:33.877345 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e0d627aa-0c3a-4a9f-931e-82e0b929b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:33.878576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1070/2132] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:33.891335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d5055-b5a4-4221-b6fe-f50520fe136a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.894067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d10d5055-b5a4-4221-b6fe-f50520fe136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:33.902386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:33.985159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1063/2133] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:33.988482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d627aa-0c3a-4a9f-931e-82e0b929b864 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.988482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e0d627aa-0c3a-4a9f-931e-82e0b929b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.001997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d627aa-0c3a-4a9f-931e-82e0b929b864 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.007937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.008582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.008920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.009194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] PATH_INFO: `/v3/users/e4835bec10064a8db7a640060b8315f9` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.014950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4835bec10064a8db7a640060b8315f9)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.016972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.027063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d5055-b5a4-4221-b6fe-f50520fe136a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.078323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4835bec10064a8db7a640060b8315f9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.087314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4835bec10064a8db7a640060b8315f9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.088121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4835bec10064a8db7a640060b8315f9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.089468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4835bec10064a8db7a640060b8315f9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.095200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:34.104387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4835bec10064a8db7a640060b8315f9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.110288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701aba0-4b7a-4609-9c0d-8a45d83899fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.111130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701aba0-4b7a-4609-9c0d-8a45d83899fd service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.111899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701aba0-4b7a-4609-9c0d-8a45d83899fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.111899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701aba0-4b7a-4609-9c0d-8a45d83899fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.114947 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c701aba0-4b7a-4609-9c0d-8a45d83899fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.130141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701aba0-4b7a-4609-9c0d-8a45d83899fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.131656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701aba0-4b7a-4609-9c0d-8a45d83899fd service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.137583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1064/2134] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:33 2022] DELETE /identity/v3/users/e4835bec10064a8db7a640060b8315f9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:34.137583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.137583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.145182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1071/2135] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:34.146581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bda744-7f4a-4ff5-8669-7f3590f76688 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.146872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bda744-7f4a-4ff5-8669-7f3590f76688 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.147144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bda744-7f4a-4ff5-8669-7f3590f76688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.171614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-19bda744-7f4a-4ff5-8669-7f3590f76688 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:34.172916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-19bda744-7f4a-4ff5-8669-7f3590f76688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.234587 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e3287-d733-47f2-92a0-f45afee94e47 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.238896 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7562fee-dff1-4b23-bec1-187a1873bd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.239672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7562fee-dff1-4b23-bec1-187a1873bd8d service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.240228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7562fee-dff1-4b23-bec1-187a1873bd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.240538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7562fee-dff1-4b23-bec1-187a1873bd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.243115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e7562fee-dff1-4b23-bec1-187a1873bd8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.258095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1072/2136] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:34.274372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bda744-7f4a-4ff5-8669-7f3590f76688 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.277468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-19bda744-7f4a-4ff5-8669-7f3590f76688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.295418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bda744-7f4a-4ff5-8669-7f3590f76688 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.301450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424d585-a4d8-4f01-b670-729ed5de41ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.302067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424d585-a4d8-4f01-b670-729ed5de41ba service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.302350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424d585-a4d8-4f01-b670-729ed5de41ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.302783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424d585-a4d8-4f01-b670-729ed5de41ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.320016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424d585-a4d8-4f01-b670-729ed5de41ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.323211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424d585-a4d8-4f01-b670-729ed5de41ba service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.327630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:34.344579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1073/2137] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:34.352899 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7562fee-dff1-4b23-bec1-187a1873bd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.355061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7562fee-dff1-4b23-bec1-187a1873bd8d service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.368298 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1065/2138] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:34.474658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424d585-a4d8-4f01-b670-729ed5de41ba service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.476119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7424d585-a4d8-4f01-b670-729ed5de41ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.492191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424d585-a4d8-4f01-b670-729ed5de41ba service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.502630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.504338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.504338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.504338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] PATH_INFO: `/v3/users/406e076b6e2d4abfa1de3de5c8b52356` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.505462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=406e076b6e2d4abfa1de3de5c8b52356)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.507629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.589176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406e076b6e2d4abfa1de3de5c8b52356'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.599302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406e076b6e2d4abfa1de3de5c8b52356'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.600135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406e076b6e2d4abfa1de3de5c8b52356'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.601233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406e076b6e2d4abfa1de3de5c8b52356'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.627196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406e076b6e2d4abfa1de3de5c8b52356'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.655551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1074/2139] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:34 2022] DELETE /identity/v3/users/406e076b6e2d4abfa1de3de5c8b52356 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:34.659621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d495a0-365e-4de1-bfc2-12f1b117d128 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.659621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d495a0-365e-4de1-bfc2-12f1b117d128 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.661952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d495a0-365e-4de1-bfc2-12f1b117d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.683658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-81d495a0-365e-4de1-bfc2-12f1b117d128 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:34.684953 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-81d495a0-365e-4de1-bfc2-12f1b117d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.741930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.746240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.788151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1066/2140] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:34.809599 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d495a0-365e-4de1-bfc2-12f1b117d128 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.812251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-81d495a0-365e-4de1-bfc2-12f1b117d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.862993 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:34.909918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d495a0-365e-4de1-bfc2-12f1b117d128 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.912138 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c99f2d-dde6-4426-9a46-066034959fd4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.917237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e06775-4d8b-4711-b7b7-4b397a2c5ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.918311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e06775-4d8b-4711-b7b7-4b397a2c5ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.918764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e06775-4d8b-4711-b7b7-4b397a2c5ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.919246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e06775-4d8b-4711-b7b7-4b397a2c5ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.924043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.924846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.925337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.936935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e06775-4d8b-4711-b7b7-4b397a2c5ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.937562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] PATH_INFO: `/v3/projects/df275d5aead44de8b6ade1527fe6144d` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.939253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e06775-4d8b-4711-b7b7-4b397a2c5ab5 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.943410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df275d5aead44de8b6ade1527fe6144d)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.946593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.953602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1067/2141] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:34.954483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e06775-4d8b-4711-b7b7-4b397a2c5ab5 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.956907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-65e06775-4d8b-4711-b7b7-4b397a2c5ab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.973981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e06775-4d8b-4711-b7b7-4b397a2c5ab5 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.986472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.987120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.987557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.987836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] PATH_INFO: `/v3/projects/530707cfa1d54a2abfa7802331e3e1f8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.989039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=530707cfa1d54a2abfa7802331e3e1f8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.991935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.059501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530707cfa1d54a2abfa7802331e3e1f8', 'request_id': 'req-90569334-fd2f-49d4-b75f-6771d6202090'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.069605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530707cfa1d54a2abfa7802331e3e1f8', 'request_id': 'req-90569334-fd2f-49d4-b75f-6771d6202090'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.077506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df275d5aead44de8b6ade1527fe6144d', 'request_id': 'req-db042898-3d9b-4733-9273-7f0ba348bcd7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.085039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530707cfa1d54a2abfa7802331e3e1f8', 'request_id': 'req-90569334-fd2f-49d4-b75f-6771d6202090'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.090895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df275d5aead44de8b6ade1527fe6144d', 'request_id': 'req-db042898-3d9b-4733-9273-7f0ba348bcd7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.099797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] The token cache is being invalidate because project 530707cfa1d54a2abfa7802331e3e1f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:35.099797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.099797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.102101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1068/2142] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:34 2022] DELETE /identity/v3/projects/530707cfa1d54a2abfa7802331e3e1f8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:35.103419 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df275d5aead44de8b6ade1527fe6144d', 'request_id': 'req-db042898-3d9b-4733-9273-7f0ba348bcd7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.107373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.110404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:35.125470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] The token cache is being invalidate because project df275d5aead44de8b6ade1527fe6144d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:35.126461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.126794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.129200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1075/2143] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:34 2022] DELETE /identity/v3/projects/df275d5aead44de8b6ade1527fe6144d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:35.132752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.133930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:35.152598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:35.231275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90569334-fd2f-49d4-b75f-6771d6202090 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.246848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.247891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.248074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.248317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] PATH_INFO: `/v3/users/408268cc1f1742e1a1b93240e0dc6a13` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.250835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] RBAC: Authorizing `identity:delete_user(user_id=408268cc1f1742e1a1b93240e0dc6a13)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.255499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.315333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db042898-3d9b-4733-9273-7f0ba348bcd7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.326619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.327584 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.328123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.328665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] PATH_INFO: `/v3/users/896a6b5f21fe481e87d3ffb6df5e42bc` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.332599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] RBAC: Authorizing `identity:delete_user(user_id=896a6b5f21fe481e87d3ffb6df5e42bc)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.335286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.347960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408268cc1f1742e1a1b93240e0dc6a13'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.363677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408268cc1f1742e1a1b93240e0dc6a13'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.364327 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408268cc1f1742e1a1b93240e0dc6a13'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.365144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408268cc1f1742e1a1b93240e0dc6a13'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.383405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408268cc1f1742e1a1b93240e0dc6a13'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.436689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1069/2144] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:35 2022] DELETE /identity/v3/users/408268cc1f1742e1a1b93240e0dc6a13 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:35.437919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.439595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:35.459625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896a6b5f21fe481e87d3ffb6df5e42bc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.472770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896a6b5f21fe481e87d3ffb6df5e42bc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.475696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896a6b5f21fe481e87d3ffb6df5e42bc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.480416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896a6b5f21fe481e87d3ffb6df5e42bc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.501995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896a6b5f21fe481e87d3ffb6df5e42bc'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.529239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:35.552656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1076/2145] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:35 2022] DELETE /identity/v3/users/896a6b5f21fe481e87d3ffb6df5e42bc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:35.573624 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56993a30-0959-4088-89cf-2807b177983c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.665155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:35.687536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.689240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:35.709746 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.710396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.710675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.711004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] PATH_INFO: `/v3/projects/9a01df843f8c4f7bb6554bcb946d8d9e` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.712540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a01df843f8c4f7bb6554bcb946d8d9e)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.715551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.788961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a01df843f8c4f7bb6554bcb946d8d9e', 'request_id': 'req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.799003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe9b79-6809-4efa-ae7a-75619338c07f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.810667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a01df843f8c4f7bb6554bcb946d8d9e', 'request_id': 'req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.843519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a01df843f8c4f7bb6554bcb946d8d9e', 'request_id': 'req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.876397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] The token cache is being invalidate because project 9a01df843f8c4f7bb6554bcb946d8d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:35.877056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.877952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-68c4b1e5-1c83-4c9c-8240-d585b0563ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.880676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1070/2146] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:35 2022] DELETE /identity/v3/projects/9a01df843f8c4f7bb6554bcb946d8d9e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:35.886386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac340-403a-4212-982d-757da8e7a36b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.887211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac340-403a-4212-982d-757da8e7a36b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.887643 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac340-403a-4212-982d-757da8e7a36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.921202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.921884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.922351 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.922627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] PATH_INFO: `/v3/projects/3214e77a6af34973b1f3ad86cd0ff64c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.922970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-bbcac340-403a-4212-982d-757da8e7a36b None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:35.925104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bbcac340-403a-4212-982d-757da8e7a36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:35.927675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3214e77a6af34973b1f3ad86cd0ff64c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.931180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.937343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1071/2147] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:35.952819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224679f4-0097-4b1d-b208-a858a79cedb8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.954115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224679f4-0097-4b1d-b208-a858a79cedb8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.954574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224679f4-0097-4b1d-b208-a858a79cedb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.984906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-224679f4-0097-4b1d-b208-a858a79cedb8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:35.987418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-224679f4-0097-4b1d-b208-a858a79cedb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.005161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1072/2148] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:36.009421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224679f4-0097-4b1d-b208-a858a79cedb8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.026285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224679f4-0097-4b1d-b208-a858a79cedb8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.047785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3214e77a6af34973b1f3ad86cd0ff64c', 'request_id': 'req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.067584 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3214e77a6af34973b1f3ad86cd0ff64c', 'request_id': 'req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.081153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3214e77a6af34973b1f3ad86cd0ff64c', 'request_id': 'req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.098619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] The token cache is being invalidate because project 3214e77a6af34973b1f3ad86cd0ff64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:36.098975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.099704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.104606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1077/2149] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:35 2022] DELETE /identity/v3/projects/3214e77a6af34973b1f3ad86cd0ff64c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:36.105739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.108244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.160543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fccf8-a898-4032-a5ef-124297ebd2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.173967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fccf8-a898-4032-a5ef-124297ebd2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.174270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fccf8-a898-4032-a5ef-124297ebd2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.174948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fccf8-a898-4032-a5ef-124297ebd2d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.176616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fccf8-a898-4032-a5ef-124297ebd2d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:36.179112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fccf8-a898-4032-a5ef-124297ebd2d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.180836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fccf8-a898-4032-a5ef-124297ebd2d7 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.183332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:36.226639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1073/2150] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:36.227551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fccf8-a898-4032-a5ef-124297ebd2d7 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.233900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711988-807e-4ddf-8cfe-d5f0d9768bb2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.237109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-504fccf8-a898-4032-a5ef-124297ebd2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.238925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.239593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.239820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.240087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] PATH_INFO: `/v3/users/16e2a957f0ff437e9a5a055c7012a50c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.241377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e2a957f0ff437e9a5a055c7012a50c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.243177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.259087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fccf8-a898-4032-a5ef-124297ebd2d7 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.265701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.266403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.267208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.267491 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] PATH_INFO: `/v3/projects/16c15107ddda4867928f0f96d2f503a6` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.268798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c15107ddda4867928f0f96d2f503a6)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.271058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.302647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e2a957f0ff437e9a5a055c7012a50c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.314878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e2a957f0ff437e9a5a055c7012a50c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.316346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e2a957f0ff437e9a5a055c7012a50c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.317401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e2a957f0ff437e9a5a055c7012a50c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.329129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e2a957f0ff437e9a5a055c7012a50c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.330268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:36.340125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c15107ddda4867928f0f96d2f503a6', 'request_id': 'req-f87d3d2d-e1ef-4de9-804c-99d525c68113'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.348057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c15107ddda4867928f0f96d2f503a6', 'request_id': 'req-f87d3d2d-e1ef-4de9-804c-99d525c68113'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.358444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c15107ddda4867928f0f96d2f503a6', 'request_id': 'req-f87d3d2d-e1ef-4de9-804c-99d525c68113'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.362529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1078/2151] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:36 2022] DELETE /identity/v3/users/16e2a957f0ff437e9a5a055c7012a50c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:36.363282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.364681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.385853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] The token cache is being invalidate because project 16c15107ddda4867928f0f96d2f503a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:36.386182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.386932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f87d3d2d-e1ef-4de9-804c-99d525c68113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.392924 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1074/2152] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:36 2022] DELETE /identity/v3/projects/16c15107ddda4867928f0f96d2f503a6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:36.406089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d8abc-f087-40de-b10e-e01b179a0161 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.406733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d8abc-f087-40de-b10e-e01b179a0161 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.407211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d8abc-f087-40de-b10e-e01b179a0161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.445316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-930d8abc-f087-40de-b10e-e01b179a0161 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:36.447764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-930d8abc-f087-40de-b10e-e01b179a0161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.463532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aef9f-44c3-46eb-be93-ae6b9541d2af admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.468552 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42914d-1bd4-4dba-bec6-5611d4f170d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.469239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42914d-1bd4-4dba-bec6-5611d4f170d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.469514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42914d-1bd4-4dba-bec6-5611d4f170d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.469782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42914d-1bd4-4dba-bec6-5611d4f170d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.470414 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42914d-1bd4-4dba-bec6-5611d4f170d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.473534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42914d-1bd4-4dba-bec6-5611d4f170d5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.532728 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1079/2153] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:36.536081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42914d-1bd4-4dba-bec6-5611d4f170d5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.538798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dd42914d-1bd4-4dba-bec6-5611d4f170d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.572686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1075/2154] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:36.574126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d8abc-f087-40de-b10e-e01b179a0161 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.575695 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-930d8abc-f087-40de-b10e-e01b179a0161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.601816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d8abc-f087-40de-b10e-e01b179a0161 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.625462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:36.658917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42914d-1bd4-4dba-bec6-5611d4f170d5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.665026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.666701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.667079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.667443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] PATH_INFO: `/v3/projects/fff3c8c828ae45ea8879878f62180411` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.669002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff3c8c828ae45ea8879878f62180411)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.671527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.676857 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea093d3-fe2b-43b7-a2d1-1746bd8e5050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.677517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea093d3-fe2b-43b7-a2d1-1746bd8e5050 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.677956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea093d3-fe2b-43b7-a2d1-1746bd8e5050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.678161 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea093d3-fe2b-43b7-a2d1-1746bd8e5050 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.678880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea093d3-fe2b-43b7-a2d1-1746bd8e5050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.681129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea093d3-fe2b-43b7-a2d1-1746bd8e5050 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.708546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1076/2155] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:36.709996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bcf13-7a6a-4995-9fad-bbeda188df7f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.710270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bcf13-7a6a-4995-9fad-bbeda188df7f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.710646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bcf13-7a6a-4995-9fad-bbeda188df7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.739291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a17bcf13-7a6a-4995-9fad-bbeda188df7f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:36.740567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a17bcf13-7a6a-4995-9fad-bbeda188df7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.764971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1077/2156] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:36.769323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bcf13-7a6a-4995-9fad-bbeda188df7f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.794211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bcf13-7a6a-4995-9fad-bbeda188df7f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.798717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff3c8c828ae45ea8879878f62180411', 'request_id': 'req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.813990 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff3c8c828ae45ea8879878f62180411', 'request_id': 'req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.824980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff3c8c828ae45ea8879878f62180411', 'request_id': 'req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.840274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] The token cache is being invalidate because project fff3c8c828ae45ea8879878f62180411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:36.840870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.841649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:36.844099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1080/2157] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:36 2022] DELETE /identity/v3/projects/fff3c8c828ae45ea8879878f62180411 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:36.845127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.847468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.883713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:36.909701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67461e3-3e6a-4f30-a914-1c155e38982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.910647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67461e3-3e6a-4f30-a914-1c155e38982a admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.911075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67461e3-3e6a-4f30-a914-1c155e38982a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.911786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67461e3-3e6a-4f30-a914-1c155e38982a admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.912668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67461e3-3e6a-4f30-a914-1c155e38982a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.914459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67461e3-3e6a-4f30-a914-1c155e38982a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.933979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1078/2158] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:36.935810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec22f1-83db-4472-8247-609f71862ba9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.936710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec22f1-83db-4472-8247-609f71862ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.937687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec22f1-83db-4472-8247-609f71862ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.969441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd122-ae0e-4c10-bc9f-07d4043531c8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.974665 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a4ec22f1-83db-4472-8247-609f71862ba9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:36.975127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc8d85-6698-4f12-828c-16fd85ec130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.975833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc8d85-6698-4f12-828c-16fd85ec130d admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.976150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a4ec22f1-83db-4472-8247-609f71862ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.976258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc8d85-6698-4f12-828c-16fd85ec130d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.976508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc8d85-6698-4f12-828c-16fd85ec130d admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.977266 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc8d85-6698-4f12-828c-16fd85ec130d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:36.977959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc8d85-6698-4f12-828c-16fd85ec130d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.980054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc8d85-6698-4f12-828c-16fd85ec130d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.987802 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1079/2159] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:36.988852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec22f1-83db-4472-8247-609f71862ba9 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.991138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a4ec22f1-83db-4472-8247-609f71862ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.996509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1081/2160] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:36.998053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99f267-97c4-443e-bfd4-50a6e1aba192 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.998394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99f267-97c4-443e-bfd4-50a6e1aba192 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.998884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99f267-97c4-443e-bfd4-50a6e1aba192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.022685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec22f1-83db-4472-8247-609f71862ba9 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.046497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-dc99f267-97c4-443e-bfd4-50a6e1aba192 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:37.048526 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dc99f267-97c4-443e-bfd4-50a6e1aba192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.048875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbff76-d4d3-43d6-936f-7d6af2c206a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.049612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbff76-d4d3-43d6-936f-7d6af2c206a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.049903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbff76-d4d3-43d6-936f-7d6af2c206a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.050224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbff76-d4d3-43d6-936f-7d6af2c206a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.051157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbff76-d4d3-43d6-936f-7d6af2c206a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.053300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbff76-d4d3-43d6-936f-7d6af2c206a5 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.068347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1082/2161] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:37.069868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99f267-97c4-443e-bfd4-50a6e1aba192 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.091645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99f267-97c4-443e-bfd4-50a6e1aba192 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.100885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1080/2162] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:37.103297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50461ed6-67b8-48ec-a665-2034785032cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.104306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461ed6-67b8-48ec-a665-2034785032cd admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.104592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461ed6-67b8-48ec-a665-2034785032cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.104958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbff76-d4d3-43d6-936f-7d6af2c206a5 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.105067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461ed6-67b8-48ec-a665-2034785032cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.105602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50461ed6-67b8-48ec-a665-2034785032cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.108603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50461ed6-67b8-48ec-a665-2034785032cd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.132289 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbff76-d4d3-43d6-936f-7d6af2c206a5 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.160184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7f258-98fc-4732-8ca2-65fbebe55c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.161450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7f258-98fc-4732-8ca2-65fbebe55c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.161988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7f258-98fc-4732-8ca2-65fbebe55c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.162447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7f258-98fc-4732-8ca2-65fbebe55c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.163480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7f258-98fc-4732-8ca2-65fbebe55c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:37.165714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7f258-98fc-4732-8ca2-65fbebe55c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.167801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7f258-98fc-4732-8ca2-65fbebe55c99 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.179998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1083/2163] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:37 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:37.184410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1081/2164] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:37.185498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50461ed6-67b8-48ec-a665-2034785032cd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.187144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7f258-98fc-4732-8ca2-65fbebe55c99 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.188960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-53e7f258-98fc-4732-8ca2-65fbebe55c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.202398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7f258-98fc-4732-8ca2-65fbebe55c99 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.236531 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:37.267725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50461ed6-67b8-48ec-a665-2034785032cd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.274809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742aec9-ff1d-44d3-b944-b29c1b1e2511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.275902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742aec9-ff1d-44d3-b944-b29c1b1e2511 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.277067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742aec9-ff1d-44d3-b944-b29c1b1e2511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.277546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742aec9-ff1d-44d3-b944-b29c1b1e2511 admin admin] PATH_INFO: `/v3/projects/2a7d3109b17a4c01a84ab6083e29c3f8/users/09a6264b7c414946b706f1b19695744f/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.277689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.278189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.278459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.278733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] PATH_INFO: `/v3/projects/54c3f68023b245c0b9b6100e1f25cc74` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.279851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c3f68023b245c0b9b6100e1f25cc74)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.282092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.298487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742aec9-ff1d-44d3-b944-b29c1b1e2511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7d3109b17a4c01a84ab6083e29c3f8, user_id=09a6264b7c414946b706f1b19695744f, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.302500 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742aec9-ff1d-44d3-b944-b29c1b1e2511 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.321253 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1084/2165] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:37 2022] PUT /identity/v3/projects/2a7d3109b17a4c01a84ab6083e29c3f8/users/09a6264b7c414946b706f1b19695744f/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:37.322565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742aec9-ff1d-44d3-b944-b29c1b1e2511 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.348882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c3f68023b245c0b9b6100e1f25cc74', 'request_id': 'req-02e617d0-85a2-4557-ba78-7fc36093a9fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:37.357588 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c3f68023b245c0b9b6100e1f25cc74', 'request_id': 'req-02e617d0-85a2-4557-ba78-7fc36093a9fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:37.367744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c3f68023b245c0b9b6100e1f25cc74', 'request_id': 'req-02e617d0-85a2-4557-ba78-7fc36093a9fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:37.383150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] The token cache is being invalidate because project 54c3f68023b245c0b9b6100e1f25cc74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:37.383434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:37.384086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:37.386439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1082/2166] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:37 2022] DELETE /identity/v3/projects/54c3f68023b245c0b9b6100e1f25cc74 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:37.387232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.388511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.407264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742aec9-ff1d-44d3-b944-b29c1b1e2511 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.446868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:37.500185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e617d0-85a2-4557-ba78-7fc36093a9fc admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.505683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287bda9-e5b1-4629-b88c-73ec1ee50223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.506378 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bda9-e5b1-4629-b88c-73ec1ee50223 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.506668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bda9-e5b1-4629-b88c-73ec1ee50223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.506975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bda9-e5b1-4629-b88c-73ec1ee50223 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.508059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287bda9-e5b1-4629-b88c-73ec1ee50223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.510050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287bda9-e5b1-4629-b88c-73ec1ee50223 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.510165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff362e7-7bc9-45c1-8007-a2a7d57c1bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.510669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff362e7-7bc9-45c1-8007-a2a7d57c1bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.510944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff362e7-7bc9-45c1-8007-a2a7d57c1bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.511211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff362e7-7bc9-45c1-8007-a2a7d57c1bfa admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.511829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff362e7-7bc9-45c1-8007-a2a7d57c1bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.513893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff362e7-7bc9-45c1-8007-a2a7d57c1bfa admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.556416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1085/2167] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:37 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:37.556416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7222a-906f-4c51-9c9e-e8f58731a9d8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.556416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7222a-906f-4c51-9c9e-e8f58731a9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.556416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7222a-906f-4c51-9c9e-e8f58731a9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.561681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1083/2168] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:37 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:37.561681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287bda9-e5b1-4629-b88c-73ec1ee50223 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.562983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2287bda9-e5b1-4629-b88c-73ec1ee50223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.617692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-abc7222a-906f-4c51-9c9e-e8f58731a9d8 None None] MFA Rules not processed for user `09a6264b7c414946b706f1b19695744f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:37.619212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-abc7222a-906f-4c51-9c9e-e8f58731a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.665506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287bda9-e5b1-4629-b88c-73ec1ee50223 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.676330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.677143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.677710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.677710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] PATH_INFO: `/v3/users/d5ffd76b44fd4c8089c01ecede30dbab` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.679082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ffd76b44fd4c8089c01ecede30dbab)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.683589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.711120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:37.738605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1086/2169] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:37.742275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7222a-906f-4c51-9c9e-e8f58731a9d8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.742275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-abc7222a-906f-4c51-9c9e-e8f58731a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.759211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7222a-906f-4c51-9c9e-e8f58731a9d8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.767113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ccb14-0793-43ef-82aa-805b83539e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.768336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ccb14-0793-43ef-82aa-805b83539e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.768701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ccb14-0793-43ef-82aa-805b83539e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.768886 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ffd76b44fd4c8089c01ecede30dbab'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:37.768995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ccb14-0793-43ef-82aa-805b83539e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.769609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ccb14-0793-43ef-82aa-805b83539e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.771391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ccb14-0793-43ef-82aa-805b83539e2f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.782470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ffd76b44fd4c8089c01ecede30dbab'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:37.783386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ffd76b44fd4c8089c01ecede30dbab'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:37.784110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ffd76b44fd4c8089c01ecede30dbab'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:37.784906 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1087/2170] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:37.785798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ccb14-0793-43ef-82aa-805b83539e2f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.798310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ffd76b44fd4c8089c01ecede30dbab'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:37.804123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-322ccb14-0793-43ef-82aa-805b83539e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.844077 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ccb14-0793-43ef-82aa-805b83539e2f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.845444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1084/2171] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:37 2022] DELETE /identity/v3/users/d5ffd76b44fd4c8089c01ecede30dbab => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:37.848985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.851531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.969905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebf8e4-b58b-40b7-8476-088eeba6acdb admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.977029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d285915-3c13-4454-9061-f9c29a2eb637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.977761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d285915-3c13-4454-9061-f9c29a2eb637 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.979829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d285915-3c13-4454-9061-f9c29a2eb637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.980487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d285915-3c13-4454-9061-f9c29a2eb637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.988532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5d285915-3c13-4454-9061-f9c29a2eb637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.996967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:38.022337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5be4f-174d-43aa-8237-04a8749ba086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:38.024833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5be4f-174d-43aa-8237-04a8749ba086 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.025126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5be4f-174d-43aa-8237-04a8749ba086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.029820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5be4f-174d-43aa-8237-04a8749ba086 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.029820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5be4f-174d-43aa-8237-04a8749ba086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:38.035971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5be4f-174d-43aa-8237-04a8749ba086 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:38.082732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1088/2172] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:37 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:38.085735 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5be4f-174d-43aa-8237-04a8749ba086 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:38.093033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a6f5be4f-174d-43aa-8237-04a8749ba086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:38.119495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5be4f-174d-43aa-8237-04a8749ba086 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:38.132294 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fe79e-1367-4f16-b91b-a9469ed3eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:38.133016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fe79e-1367-4f16-b91b-a9469ed3eebd admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.133302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fe79e-1367-4f16-b91b-a9469ed3eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.133577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fe79e-1367-4f16-b91b-a9469ed3eebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.134239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fe79e-1367-4f16-b91b-a9469ed3eebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:38.136651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fe79e-1367-4f16-b91b-a9469ed3eebd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:38.159712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d285915-3c13-4454-9061-f9c29a2eb637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:38.161812 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d285915-3c13-4454-9061-f9c29a2eb637 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:38.163833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1089/2173] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:38.164793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fe79e-1367-4f16-b91b-a9469ed3eebd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:38.185469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fe79e-1367-4f16-b91b-a9469ed3eebd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:38.187793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1085/2174] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:38.188789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d285915-3c13-4454-9061-f9c29a2eb637 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:38.225150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d285915-3c13-4454-9061-f9c29a2eb637 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:38.226520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bf31b-25cf-441f-aeed-758fe579f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:38.227152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf31b-25cf-441f-aeed-758fe579f4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.227428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf31b-25cf-441f-aeed-758fe579f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.227698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf31b-25cf-441f-aeed-758fe579f4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.228458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bf31b-25cf-441f-aeed-758fe579f4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:38.230771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bf31b-25cf-441f-aeed-758fe579f4c8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:38.231658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e947b-4d3a-4e0e-8672-bccaf1e66cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:38.232674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e947b-4d3a-4e0e-8672-bccaf1e66cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.233022 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e947b-4d3a-4e0e-8672-bccaf1e66cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.233363 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e947b-4d3a-4e0e-8672-bccaf1e66cd4 admin admin] PATH_INFO: `/v3/projects/9d3dfcea95084e189f7a4ba9bca944c7/users/f3feb22d1b1e40f5baaffb2d15f9577e/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.258526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e947b-4d3a-4e0e-8672-bccaf1e66cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3dfcea95084e189f7a4ba9bca944c7, user_id=f3feb22d1b1e40f5baaffb2d15f9577e, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:38.262403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e947b-4d3a-4e0e-8672-bccaf1e66cd4 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:38.264493 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1090/2175] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:38.268684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bf31b-25cf-441f-aeed-758fe579f4c8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:38.292945 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bf31b-25cf-441f-aeed-758fe579f4c8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:38.296685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1086/2176] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:38 2022] PUT /identity/v3/projects/9d3dfcea95084e189f7a4ba9bca944c7/users/f3feb22d1b1e40f5baaffb2d15f9577e/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:38.316609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656474d-4027-461a-8335-90084e696de3 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.316609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656474d-4027-461a-8335-90084e696de3 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.316609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656474d-4027-461a-8335-90084e696de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.404578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9656474d-4027-461a-8335-90084e696de3 None None] MFA Rules not processed for user `f3feb22d1b1e40f5baaffb2d15f9577e`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:38.405858 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9656474d-4027-461a-8335-90084e696de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:38.541639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298ad3-bdcd-4c23-a06a-d2fcb5fa3405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:38.542536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298ad3-bdcd-4c23-a06a-d2fcb5fa3405 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.543202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298ad3-bdcd-4c23-a06a-d2fcb5fa3405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.543630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298ad3-bdcd-4c23-a06a-d2fcb5fa3405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.544419 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20298ad3-bdcd-4c23-a06a-d2fcb5fa3405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:38.546325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20298ad3-bdcd-4c23-a06a-d2fcb5fa3405 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:38.563534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1091/2177] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:38.564673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298ad3-bdcd-4c23-a06a-d2fcb5fa3405 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:38.566580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-20298ad3-bdcd-4c23-a06a-d2fcb5fa3405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:38.590250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298ad3-bdcd-4c23-a06a-d2fcb5fa3405 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:38.594263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1087/2178] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:38.597801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656474d-4027-461a-8335-90084e696de3 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:38.606250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:38.606976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.607258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.607535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] PATH_INFO: `/v3/projects/0a8388741a4f457791362dcb823dea1a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.609418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8388741a4f457791362dcb823dea1a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:38.611959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:38.650312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656474d-4027-461a-8335-90084e696de3 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:38.675262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f8489-a762-4b7c-b4d4-907083de739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:38.676531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f8489-a762-4b7c-b4d4-907083de739d admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.677086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f8489-a762-4b7c-b4d4-907083de739d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.677710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f8489-a762-4b7c-b4d4-907083de739d admin admin] PATH_INFO: `/v3/projects/0d5f222e7331491b852fdfecb0384247/users/147f56db02dd4608b6fd37ef8f6e9daf/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.692864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:38.724260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f8489-a762-4b7c-b4d4-907083de739d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5f222e7331491b852fdfecb0384247, user_id=147f56db02dd4608b6fd37ef8f6e9daf, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:38.726674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8388741a4f457791362dcb823dea1a', 'request_id': 'req-2db60310-a982-410d-86b0-8e191f82ea2b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:38.727703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f8489-a762-4b7c-b4d4-907083de739d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:38.741029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8388741a4f457791362dcb823dea1a', 'request_id': 'req-2db60310-a982-410d-86b0-8e191f82ea2b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:38.752326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8388741a4f457791362dcb823dea1a', 'request_id': 'req-2db60310-a982-410d-86b0-8e191f82ea2b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:38.761056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1088/2179] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:38 2022] PUT /identity/v3/projects/0d5f222e7331491b852fdfecb0384247/users/147f56db02dd4608b6fd37ef8f6e9daf/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:38.765190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f8489-a762-4b7c-b4d4-907083de739d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:38.776260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] The token cache is being invalidate because project 0a8388741a4f457791362dcb823dea1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:38.776542 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:38.777224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2db60310-a982-410d-86b0-8e191f82ea2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:38.783291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1092/2180] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:38 2022] DELETE /identity/v3/projects/0a8388741a4f457791362dcb823dea1a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:38.784653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8d3b3-1d29-42c3-887e-1e68fa0ad27f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.784928 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8d3b3-1d29-42c3-887e-1e68fa0ad27f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.785199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8d3b3-1d29-42c3-887e-1e68fa0ad27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.828300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-9fd8d3b3-1d29-42c3-887e-1e68fa0ad27f None None] MFA Rules not processed for user `147f56db02dd4608b6fd37ef8f6e9daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:38.829610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9fd8d3b3-1d29-42c3-887e-1e68fa0ad27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:38.836828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:38.852156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f8489-a762-4b7c-b4d4-907083de739d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:38.858234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41679b-2d60-4a50-98c5-378afb288f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:38.859595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41679b-2d60-4a50-98c5-378afb288f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.859875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41679b-2d60-4a50-98c5-378afb288f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.860137 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41679b-2d60-4a50-98c5-378afb288f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.860949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41679b-2d60-4a50-98c5-378afb288f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:38.862928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41679b-2d60-4a50-98c5-378afb288f18 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:38.897650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1089/2181] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:38 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:38.899366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5202e0-1b1e-457c-a23a-f715967ed232 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:38.899648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5202e0-1b1e-457c-a23a-f715967ed232 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:38.900734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5202e0-1b1e-457c-a23a-f715967ed232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:38.912441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1093/2182] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:38.913260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8d3b3-1d29-42c3-887e-1e68fa0ad27f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:38.922816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-9fd8d3b3-1d29-42c3-887e-1e68fa0ad27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:38.927680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-3a5202e0-1b1e-457c-a23a-f715967ed232 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:38.929106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3a5202e0-1b1e-457c-a23a-f715967ed232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:38.938851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8d3b3-1d29-42c3-887e-1e68fa0ad27f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.009859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0bbbe-216b-4960-8ff7-c145d9ec1bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.010476 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0bbbe-216b-4960-8ff7-c145d9ec1bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.010754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0bbbe-216b-4960-8ff7-c145d9ec1bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.011113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0bbbe-216b-4960-8ff7-c145d9ec1bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.011645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0bbbe-216b-4960-8ff7-c145d9ec1bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.013628 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0bbbe-216b-4960-8ff7-c145d9ec1bd7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.020234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1090/2183] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:39.021208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5202e0-1b1e-457c-a23a-f715967ed232 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.022680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3a5202e0-1b1e-457c-a23a-f715967ed232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.036660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1094/2184] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:38 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:39.037998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39944710-b480-425a-b208-59a542450412 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.038351 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39944710-b480-425a-b208-59a542450412 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.038766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39944710-b480-425a-b208-59a542450412 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.040737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1095/2185] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:39.042268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39944710-b480-425a-b208-59a542450412 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.044129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-39944710-b480-425a-b208-59a542450412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.067552 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39944710-b480-425a-b208-59a542450412 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.079022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.079891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.080177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.080482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] PATH_INFO: `/v3/users/646ce2a5be91485a9f785e7f41a3e9ab` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.081711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] RBAC: Authorizing `identity:delete_user(user_id=646ce2a5be91485a9f785e7f41a3e9ab)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.083709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.103078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5202e0-1b1e-457c-a23a-f715967ed232 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.107760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1119ae0-c11f-4098-a954-074b7282bd4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.108366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119ae0-c11f-4098-a954-074b7282bd4e service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.108667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119ae0-c11f-4098-a954-074b7282bd4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.108943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119ae0-c11f-4098-a954-074b7282bd4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.138340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:39.161087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646ce2a5be91485a9f785e7f41a3e9ab'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.173592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646ce2a5be91485a9f785e7f41a3e9ab'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.174923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646ce2a5be91485a9f785e7f41a3e9ab'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.176439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646ce2a5be91485a9f785e7f41a3e9ab'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.177050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1119ae0-c11f-4098-a954-074b7282bd4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.178506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1119ae0-c11f-4098-a954-074b7282bd4e service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.184834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646ce2a5be91485a9f785e7f41a3e9ab'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.189368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1091/2186] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:39.191013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72f4f9-3c3f-4910-8d03-31d9a2f172ef None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.191302 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72f4f9-3c3f-4910-8d03-31d9a2f172ef None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.191667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72f4f9-3c3f-4910-8d03-31d9a2f172ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.214989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-3f72f4f9-3c3f-4910-8d03-31d9a2f172ef None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:39.216200 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3f72f4f9-3c3f-4910-8d03-31d9a2f172ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.218449 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1096/2187] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:39 2022] DELETE /identity/v3/users/646ce2a5be91485a9f785e7f41a3e9ab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:39.219353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.220765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.250225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:39.297125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1092/2188] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:39.298661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe758c-ace9-43ed-95cb-d6f35909118d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.298957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe758c-ace9-43ed-95cb-d6f35909118d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.299234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe758c-ace9-43ed-95cb-d6f35909118d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.309374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802905b5-73d0-4373-aae6-27d8b43e470f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.320135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-eefe758c-ace9-43ed-95cb-d6f35909118d None None] MFA Rules not processed for user `c7f2e22ace8648919104c910c74c1711`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:39.320350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597177a-0c6b-4a76-a651-27d76c790e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.320958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597177a-0c6b-4a76-a651-27d76c790e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.321236 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597177a-0c6b-4a76-a651-27d76c790e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.321408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-eefe758c-ace9-43ed-95cb-d6f35909118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.321509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597177a-0c6b-4a76-a651-27d76c790e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.322423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597177a-0c6b-4a76-a651-27d76c790e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.324189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597177a-0c6b-4a76-a651-27d76c790e53 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.335544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1097/2189] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:39.336378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597177a-0c6b-4a76-a651-27d76c790e53 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.338712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b597177a-0c6b-4a76-a651-27d76c790e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.352156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597177a-0c6b-4a76-a651-27d76c790e53 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.357762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.358494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.358843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.359172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] PATH_INFO: `/v3/users/147f56db02dd4608b6fd37ef8f6e9daf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.360847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147f56db02dd4608b6fd37ef8f6e9daf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.362630 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.420680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1093/2190] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:39.420680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe758c-ace9-43ed-95cb-d6f35909118d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.428158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147f56db02dd4608b6fd37ef8f6e9daf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.436602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe758c-ace9-43ed-95cb-d6f35909118d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.442025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9f925-cca4-43e3-b3fa-38ea65c850d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.442633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9f925-cca4-43e3-b3fa-38ea65c850d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.442906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9f925-cca4-43e3-b3fa-38ea65c850d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.443171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9f925-cca4-43e3-b3fa-38ea65c850d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.443804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9f925-cca4-43e3-b3fa-38ea65c850d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:39.444100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9f925-cca4-43e3-b3fa-38ea65c850d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.446201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9f925-cca4-43e3-b3fa-38ea65c850d0 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.448394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147f56db02dd4608b6fd37ef8f6e9daf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.449535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147f56db02dd4608b6fd37ef8f6e9daf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.450537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147f56db02dd4608b6fd37ef8f6e9daf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.462275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147f56db02dd4608b6fd37ef8f6e9daf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.470660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1094/2191] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:39.471769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9f925-cca4-43e3-b3fa-38ea65c850d0 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.474262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2cb9f925-cca4-43e3-b3fa-38ea65c850d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.491600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9f925-cca4-43e3-b3fa-38ea65c850d0 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.496831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4866a0-cff6-4a36-8b2e-f8aba4b289a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.497498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4866a0-cff6-4a36-8b2e-f8aba4b289a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.497780 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4866a0-cff6-4a36-8b2e-f8aba4b289a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.498049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4866a0-cff6-4a36-8b2e-f8aba4b289a6 admin admin] PATH_INFO: `/v3/projects/d60fccfd43c848d38a986e3a430b9fbd/users/5e046ef204bc417298633fd807b4fe59/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.504238 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1098/2192] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:39 2022] DELETE /identity/v3/users/147f56db02dd4608b6fd37ef8f6e9daf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:39.505263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.507247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.518095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4866a0-cff6-4a36-8b2e-f8aba4b289a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60fccfd43c848d38a986e3a430b9fbd, user_id=5e046ef204bc417298633fd807b4fe59, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.520821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4866a0-cff6-4a36-8b2e-f8aba4b289a6 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.538342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1095/2193] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:39 2022] PUT /identity/v3/projects/d60fccfd43c848d38a986e3a430b9fbd/users/5e046ef204bc417298633fd807b4fe59/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:39.539194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4866a0-cff6-4a36-8b2e-f8aba4b289a6 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.543438 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9e4866a0-cff6-4a36-8b2e-f8aba4b289a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.545894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:39.607627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf966a-c46a-4d1b-8965-5ef3e40d9147 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.616618 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4866a0-cff6-4a36-8b2e-f8aba4b289a6 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.630254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.630892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.631159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.631427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] PATH_INFO: `/v3/projects/6848f49a6a854f828a851ec42b649ec1` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.632562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6848f49a6a854f828a851ec42b649ec1)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.634525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.673196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:39.678765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc9584-243a-4756-9bf3-50d05fa2b640 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.679383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc9584-243a-4756-9bf3-50d05fa2b640 service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.679648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc9584-243a-4756-9bf3-50d05fa2b640 service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.679917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc9584-243a-4756-9bf3-50d05fa2b640 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.682604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5cfc9584-243a-4756-9bf3-50d05fa2b640 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.688446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6848f49a6a854f828a851ec42b649ec1', 'request_id': 'req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.693874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc9584-243a-4756-9bf3-50d05fa2b640 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.694013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6848f49a6a854f828a851ec42b649ec1', 'request_id': 'req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.695431 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc9584-243a-4756-9bf3-50d05fa2b640 service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.705108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6848f49a6a854f828a851ec42b649ec1', 'request_id': 'req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.706922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1099/2194] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:39.714279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc9584-243a-4756-9bf3-50d05fa2b640 service placement] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.715704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5cfc9584-243a-4756-9bf3-50d05fa2b640 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.718690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] The token cache is being invalidate because project 6848f49a6a854f828a851ec42b649ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:39.718982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.719648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2ef71e5d-8c5d-4520-b495-ff59a7e426e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:39.725878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1096/2195] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:39 2022] DELETE /identity/v3/projects/6848f49a6a854f828a851ec42b649ec1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:39.727186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9602d6-c73d-4008-9aed-5640cc627a55 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.727466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9602d6-c73d-4008-9aed-5640cc627a55 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.727737 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9602d6-c73d-4008-9aed-5640cc627a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.737388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc9584-243a-4756-9bf3-50d05fa2b640 service placement] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.751481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5a9602d6-c73d-4008-9aed-5640cc627a55 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:39.753165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5a9602d6-c73d-4008-9aed-5640cc627a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.822074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a1c7d-e8b6-4e60-9d61-fd76ad636c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.823002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a1c7d-e8b6-4e60-9d61-fd76ad636c63 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.823332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a1c7d-e8b6-4e60-9d61-fd76ad636c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.823615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a1c7d-e8b6-4e60-9d61-fd76ad636c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.824227 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a1c7d-e8b6-4e60-9d61-fd76ad636c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.826145 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a1c7d-e8b6-4e60-9d61-fd76ad636c63 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.826274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1097/2196] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:39.827280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9602d6-c73d-4008-9aed-5640cc627a55 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.833979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5a9602d6-c73d-4008-9aed-5640cc627a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.849184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9602d6-c73d-4008-9aed-5640cc627a55 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.859831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1100/2197] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:39 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:39.859831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a74a7-b1cb-49ba-9824-1a5e79903dae None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.859831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a74a7-b1cb-49ba-9824-1a5e79903dae None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.859831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a74a7-b1cb-49ba-9824-1a5e79903dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.867664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafd75a-9642-4d1a-8790-31443f33ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:39.868769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafd75a-9642-4d1a-8790-31443f33ef30 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:39.868769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafd75a-9642-4d1a-8790-31443f33ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:39.868934 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafd75a-9642-4d1a-8790-31443f33ef30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:39.870090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafd75a-9642-4d1a-8790-31443f33ef30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:39.871807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafd75a-9642-4d1a-8790-31443f33ef30 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:39.885287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1098/2198] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:39.885569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2c9a74a7-b1cb-49ba-9824-1a5e79903dae None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:39.885662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafd75a-9642-4d1a-8790-31443f33ef30 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.885736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2c9a74a7-b1cb-49ba-9824-1a5e79903dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.887581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3cafd75a-9642-4d1a-8790-31443f33ef30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:39.929284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:39.969744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafd75a-9642-4d1a-8790-31443f33ef30 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:39.990335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1101/2199] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:39.991021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a74a7-b1cb-49ba-9824-1a5e79903dae None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:39.992356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2c9a74a7-b1cb-49ba-9824-1a5e79903dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:40.005563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a74a7-b1cb-49ba-9824-1a5e79903dae None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.012121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd604871-d504-4e35-b0ce-11b4a97f2c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.013031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604871-d504-4e35-b0ce-11b4a97f2c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.013308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604871-d504-4e35-b0ce-11b4a97f2c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.013645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604871-d504-4e35-b0ce-11b4a97f2c51 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.014461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd604871-d504-4e35-b0ce-11b4a97f2c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.019673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd604871-d504-4e35-b0ce-11b4a97f2c51 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.042306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a9f76-4e06-4588-804d-5f7447a8dcde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.042922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a9f76-4e06-4588-804d-5f7447a8dcde service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.046841 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a9f76-4e06-4588-804d-5f7447a8dcde service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.046994 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1102/2200] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:39 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:40.047078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a9f76-4e06-4588-804d-5f7447a8dcde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.047151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd604871-d504-4e35-b0ce-11b4a97f2c51 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.059626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a9f76-4e06-4588-804d-5f7447a8dcde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.060462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd604871-d504-4e35-b0ce-11b4a97f2c51 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.061257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a9f76-4e06-4588-804d-5f7447a8dcde service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.069396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca77b05-78f1-4662-b46e-fc25372877d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.070078 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca77b05-78f1-4662-b46e-fc25372877d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.070551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca77b05-78f1-4662-b46e-fc25372877d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.070911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca77b05-78f1-4662-b46e-fc25372877d7 admin admin] PATH_INFO: `/v3/projects/d60fccfd43c848d38a986e3a430b9fbd/users/5e046ef204bc417298633fd807b4fe59/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.076474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1099/2201] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:40.077339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca77b05-78f1-4662-b46e-fc25372877d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60fccfd43c848d38a986e3a430b9fbd, user_id=5e046ef204bc417298633fd807b4fe59, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.078776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968189-4ed6-4d8a-8fe1-1578628485c1 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.079333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968189-4ed6-4d8a-8fe1-1578628485c1 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.079804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968189-4ed6-4d8a-8fe1-1578628485c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.080583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca77b05-78f1-4662-b46e-fc25372877d7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.094593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1103/2202] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:40 2022] PUT /identity/v3/projects/d60fccfd43c848d38a986e3a430b9fbd/users/5e046ef204bc417298633fd807b4fe59/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:40.095490 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca77b05-78f1-4662-b46e-fc25372877d7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.100204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:40.114060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d0968189-4ed6-4d8a-8fe1-1578628485c1 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:40.115766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d0968189-4ed6-4d8a-8fe1-1578628485c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:40.208844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca77b05-78f1-4662-b46e-fc25372877d7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.225207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4471949-b656-4465-8e65-1083db14fc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.225837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471949-b656-4465-8e65-1083db14fc4b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.226108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471949-b656-4465-8e65-1083db14fc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.226373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471949-b656-4465-8e65-1083db14fc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.227025 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4471949-b656-4465-8e65-1083db14fc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.229757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4471949-b656-4465-8e65-1083db14fc4b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.246176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1104/2203] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:40.246653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1100/2204] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:40.247901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db28ff-6db1-4d65-9395-e811ddd18c74 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.248327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db28ff-6db1-4d65-9395-e811ddd18c74 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.248666 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db28ff-6db1-4d65-9395-e811ddd18c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.250118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0968189-4ed6-4d8a-8fe1-1578628485c1 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.266545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0968189-4ed6-4d8a-8fe1-1578628485c1 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.279574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346c87b-4441-4354-8462-227ad6d8c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.280372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346c87b-4441-4354-8462-227ad6d8c307 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.280767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346c87b-4441-4354-8462-227ad6d8c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.281420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346c87b-4441-4354-8462-227ad6d8c307 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.282361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346c87b-4441-4354-8462-227ad6d8c307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:40.282751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346c87b-4441-4354-8462-227ad6d8c307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.284576 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346c87b-4441-4354-8462-227ad6d8c307 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.296423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c4db28ff-6db1-4d65-9395-e811ddd18c74 None None] MFA Rules not processed for user `5e046ef204bc417298633fd807b4fe59`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:40.298105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c4db28ff-6db1-4d65-9395-e811ddd18c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:40.300248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1101/2205] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:40.305872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346c87b-4441-4354-8462-227ad6d8c307 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.321814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346c87b-4441-4354-8462-227ad6d8c307 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.327728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b372ba-1adf-47fa-823c-3da5a71f8c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.328358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b372ba-1adf-47fa-823c-3da5a71f8c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.328654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b372ba-1adf-47fa-823c-3da5a71f8c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.328928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b372ba-1adf-47fa-823c-3da5a71f8c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.329563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b372ba-1adf-47fa-823c-3da5a71f8c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.332808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b372ba-1adf-47fa-823c-3da5a71f8c38 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.343112 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1102/2206] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:40.344367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b372ba-1adf-47fa-823c-3da5a71f8c38 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.358662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b372ba-1adf-47fa-823c-3da5a71f8c38 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.365246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dc125-3fe3-4eae-ab52-e30ea5f1df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.365951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dc125-3fe3-4eae-ab52-e30ea5f1df1d admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.366341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dc125-3fe3-4eae-ab52-e30ea5f1df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.366843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dc125-3fe3-4eae-ab52-e30ea5f1df1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.367656 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271dc125-3fe3-4eae-ab52-e30ea5f1df1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.370781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271dc125-3fe3-4eae-ab52-e30ea5f1df1d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.413435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1103/2207] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:40 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:40.417618 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dc125-3fe3-4eae-ab52-e30ea5f1df1d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.419097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1105/2208] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:40.419998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db28ff-6db1-4d65-9395-e811ddd18c74 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.437348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db28ff-6db1-4d65-9395-e811ddd18c74 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.473895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:40.501027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dc125-3fe3-4eae-ab52-e30ea5f1df1d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.508647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da51ca7-c467-4d3e-a428-f2aac170df77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.509652 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da51ca7-c467-4d3e-a428-f2aac170df77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.510007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da51ca7-c467-4d3e-a428-f2aac170df77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.511260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da51ca7-c467-4d3e-a428-f2aac170df77 admin admin] PATH_INFO: `/v3/projects/b44f5c305ad14100b0cba168b7d68a0a/users/6238784256484453ac3ca666a23b39fa/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.520081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d516-0e5c-4ec3-aa01-d6d262b23c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.520859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d516-0e5c-4ec3-aa01-d6d262b23c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.521211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d516-0e5c-4ec3-aa01-d6d262b23c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.521554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d516-0e5c-4ec3-aa01-d6d262b23c3f admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.522320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6d516-0e5c-4ec3-aa01-d6d262b23c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.524391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6d516-0e5c-4ec3-aa01-d6d262b23c3f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.536231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da51ca7-c467-4d3e-a428-f2aac170df77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44f5c305ad14100b0cba168b7d68a0a, user_id=6238784256484453ac3ca666a23b39fa, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.542603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da51ca7-c467-4d3e-a428-f2aac170df77 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.556193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1106/2209] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:40 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:40.557144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d516-0e5c-4ec3-aa01-d6d262b23c3f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.559701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e8e6d516-0e5c-4ec3-aa01-d6d262b23c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:40.569353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1104/2210] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:40 2022] PUT /identity/v3/projects/b44f5c305ad14100b0cba168b7d68a0a/users/6238784256484453ac3ca666a23b39fa/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:40.570839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da51ca7-c467-4d3e-a428-f2aac170df77 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.645176 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:40.651434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d516-0e5c-4ec3-aa01-d6d262b23c3f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.697574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da51ca7-c467-4d3e-a428-f2aac170df77 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.711758 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa3b6b-1198-4b38-9535-62d843ab65b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.712472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa3b6b-1198-4b38-9535-62d843ab65b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.713391 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa3b6b-1198-4b38-9535-62d843ab65b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.713734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa3b6b-1198-4b38-9535-62d843ab65b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.714451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa3b6b-1198-4b38-9535-62d843ab65b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.716125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa3b6b-1198-4b38-9535-62d843ab65b4 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.741881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1105/2211] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:40.743229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dac0e4-1df9-413f-b87c-c5082a1fe143 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.743489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dac0e4-1df9-413f-b87c-c5082a1fe143 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.743764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dac0e4-1df9-413f-b87c-c5082a1fe143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.757251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbacec-9530-4406-a359-71d52db61502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.759346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbacec-9530-4406-a359-71d52db61502 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.759809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbacec-9530-4406-a359-71d52db61502 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.760115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbacec-9530-4406-a359-71d52db61502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.762998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-22cbacec-9530-4406-a359-71d52db61502 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:40.784775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-95dac0e4-1df9-413f-b87c-c5082a1fe143 None None] MFA Rules not processed for user `6238784256484453ac3ca666a23b39fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:40.786351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-95dac0e4-1df9-413f-b87c-c5082a1fe143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:40.847713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbacec-9530-4406-a359-71d52db61502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.849734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbacec-9530-4406-a359-71d52db61502 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.872892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1107/2212] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:40.873765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbacec-9530-4406-a359-71d52db61502 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.875711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-22cbacec-9530-4406-a359-71d52db61502 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:40.895249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbacec-9530-4406-a359-71d52db61502 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.903211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1106/2213] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:40.903211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dac0e4-1df9-413f-b87c-c5082a1fe143 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.913322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dac0e4-1df9-413f-b87c-c5082a1fe143 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.914310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.915014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.915231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.915553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] PATH_INFO: `/v3/projects/0d5f222e7331491b852fdfecb0384247` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.916872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5f222e7331491b852fdfecb0384247)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.918939 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec481d-0ef7-44bd-ad10-8fd63eb684c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:40.919398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.919672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec481d-0ef7-44bd-ad10-8fd63eb684c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:40.920017 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec481d-0ef7-44bd-ad10-8fd63eb684c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:40.920355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec481d-0ef7-44bd-ad10-8fd63eb684c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:40.921246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec481d-0ef7-44bd-ad10-8fd63eb684c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:40.923014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec481d-0ef7-44bd-ad10-8fd63eb684c9 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:40.943094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1107/2214] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:40.944173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec481d-0ef7-44bd-ad10-8fd63eb684c9 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:40.946560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-84ec481d-0ef7-44bd-ad10-8fd63eb684c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:40.949821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:40.967552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec481d-0ef7-44bd-ad10-8fd63eb684c9 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:40.985143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5f222e7331491b852fdfecb0384247', 'request_id': 'req-a002862a-1a21-4e25-89af-b84b02b159ed'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:41.003078 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5f222e7331491b852fdfecb0384247', 'request_id': 'req-a002862a-1a21-4e25-89af-b84b02b159ed'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:41.013966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5f222e7331491b852fdfecb0384247', 'request_id': 'req-a002862a-1a21-4e25-89af-b84b02b159ed'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:41.029911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b89cc9-ecaa-4e8d-9eb5-fade6bbb6878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.030677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89cc9-ecaa-4e8d-9eb5-fade6bbb6878 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.030956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89cc9-ecaa-4e8d-9eb5-fade6bbb6878 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.031231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89cc9-ecaa-4e8d-9eb5-fade6bbb6878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.032512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] The token cache is being invalidate because project 0d5f222e7331491b852fdfecb0384247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:41.032883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:41.033693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:41.040474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1108/2215] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:40 2022] DELETE /identity/v3/projects/0d5f222e7331491b852fdfecb0384247 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:41.046097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:41.047557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:41.123647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b89cc9-ecaa-4e8d-9eb5-fade6bbb6878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.125099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b89cc9-ecaa-4e8d-9eb5-fade6bbb6878 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:41.130640 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002862a-1a21-4e25-89af-b84b02b159ed admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:41.136760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1108/2216] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:41.138486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0de8b-019f-4c10-9d6e-09c1524bfbb0 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.139280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0de8b-019f-4c10-9d6e-09c1524bfbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.139788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0de8b-019f-4c10-9d6e-09c1524bfbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.141043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a32ec-ff0e-4fe4-8067-7ca9fe5ec47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.142171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a32ec-ff0e-4fe4-8067-7ca9fe5ec47e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.142617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a32ec-ff0e-4fe4-8067-7ca9fe5ec47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.143035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a32ec-ff0e-4fe4-8067-7ca9fe5ec47e admin admin] PATH_INFO: `/v3/projects/cbc3408c12384818b8389e6a0b1224c4/users/d401f4d03dfc4391af76a99c91eb37e1/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.169131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a32ec-ff0e-4fe4-8067-7ca9fe5ec47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc3408c12384818b8389e6a0b1224c4, user_id=d401f4d03dfc4391af76a99c91eb37e1, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.171841 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a32ec-ff0e-4fe4-8067-7ca9fe5ec47e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:41.177514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-f6b0de8b-019f-4c10-9d6e-09c1524bfbb0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:41.179477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f6b0de8b-019f-4c10-9d6e-09c1524bfbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:41.191726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:41.193975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1109/2217] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:41 2022] PUT /identity/v3/projects/cbc3408c12384818b8389e6a0b1224c4/users/d401f4d03dfc4391af76a99c91eb37e1/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:41.198955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a32ec-ff0e-4fe4-8067-7ca9fe5ec47e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:41.201086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-140a32ec-ff0e-4fe4-8067-7ca9fe5ec47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:41.299517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1109/2218] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:41.307447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce133d4-3281-4cec-819c-bfa17f32d901 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.307711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce133d4-3281-4cec-819c-bfa17f32d901 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.307986 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce133d4-3281-4cec-819c-bfa17f32d901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.310592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a32ec-ff0e-4fe4-8067-7ca9fe5ec47e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:41.325622 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.326703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.327216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.327631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] PATH_INFO: `/v3/users/6238784256484453ac3ca666a23b39fa` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.329296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6238784256484453ac3ca666a23b39fa)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.331595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:41.343902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-bce133d4-3281-4cec-819c-bfa17f32d901 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:41.345160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bce133d4-3281-4cec-819c-bfa17f32d901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:41.354504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1110/2219] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:41.357905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0182916-2c42-4e54-9b74-d0abacce0e55 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.357905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0182916-2c42-4e54-9b74-d0abacce0e55 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.357905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0182916-2c42-4e54-9b74-d0abacce0e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.388285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a0182916-2c42-4e54-9b74-d0abacce0e55 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:41.389789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a0182916-2c42-4e54-9b74-d0abacce0e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:41.399834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1111/2220] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:41.401767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0182916-2c42-4e54-9b74-d0abacce0e55 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:41.403304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a0182916-2c42-4e54-9b74-d0abacce0e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:41.406196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:41.419467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6238784256484453ac3ca666a23b39fa'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:41.429105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6238784256484453ac3ca666a23b39fa'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:41.429828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6238784256484453ac3ca666a23b39fa'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:41.430443 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6238784256484453ac3ca666a23b39fa'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:41.439327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6238784256484453ac3ca666a23b39fa'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:41.459843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1110/2221] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:41 2022] DELETE /identity/v3/users/6238784256484453ac3ca666a23b39fa => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:41.460839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:41.462424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:41.484647 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0182916-2c42-4e54-9b74-d0abacce0e55 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:41.538007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacfd57-1cf8-4229-bd2c-6e7885119dab admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:41.539209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552fe44-4c5e-40d4-af8f-17a34f1bfc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.539990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552fe44-4c5e-40d4-af8f-17a34f1bfc54 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.540269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552fe44-4c5e-40d4-af8f-17a34f1bfc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.540537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552fe44-4c5e-40d4-af8f-17a34f1bfc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.543311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3552fe44-4c5e-40d4-af8f-17a34f1bfc54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:41.545138 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6a209-c3c3-49ac-a659-965988108981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.546023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a209-c3c3-49ac-a659-965988108981 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.546531 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a209-c3c3-49ac-a659-965988108981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.546713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a209-c3c3-49ac-a659-965988108981 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.547663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6a209-c3c3-49ac-a659-965988108981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:41.547971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6a209-c3c3-49ac-a659-965988108981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.549702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6a209-c3c3-49ac-a659-965988108981 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:41.558360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552fe44-4c5e-40d4-af8f-17a34f1bfc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.560610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552fe44-4c5e-40d4-af8f-17a34f1bfc54 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:41.566658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1111/2222] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:41.566658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d656d-d9d2-4a4e-b9b6-554f0bc615d3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.566658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d656d-d9d2-4a4e-b9b6-554f0bc615d3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.566658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d656d-d9d2-4a4e-b9b6-554f0bc615d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.577528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1112/2223] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:41.578421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552fe44-4c5e-40d4-af8f-17a34f1bfc54 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:41.591349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d81d656d-d9d2-4a4e-b9b6-554f0bc615d3 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:41.593433 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d81d656d-d9d2-4a4e-b9b6-554f0bc615d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:41.593564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552fe44-4c5e-40d4-af8f-17a34f1bfc54 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:41.600198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4e16e-5e7c-4476-9e0a-b35259179b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.601450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e16e-5e7c-4476-9e0a-b35259179b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.601734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e16e-5e7c-4476-9e0a-b35259179b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.602025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e16e-5e7c-4476-9e0a-b35259179b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.602702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4e16e-5e7c-4476-9e0a-b35259179b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.605275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4e16e-5e7c-4476-9e0a-b35259179b3b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:41.609717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1112/2224] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:41.618740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d656d-d9d2-4a4e-b9b6-554f0bc615d3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:41.621055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d81d656d-d9d2-4a4e-b9b6-554f0bc615d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:41.639522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d656d-d9d2-4a4e-b9b6-554f0bc615d3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:41.644252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febd9f-e66d-4771-95a1-6a4812184361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.644911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febd9f-e66d-4771-95a1-6a4812184361 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.645244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febd9f-e66d-4771-95a1-6a4812184361 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.646503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febd9f-e66d-4771-95a1-6a4812184361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.659876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81febd9f-e66d-4771-95a1-6a4812184361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.660070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1113/2225] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:41 2022] POST /identity/v3/projects => generated 363 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:41.660910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4e16e-5e7c-4476-9e0a-b35259179b3b admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:41.662670 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81febd9f-e66d-4771-95a1-6a4812184361 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:41.684133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1113/2226] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:41.772769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:41.807013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4e16e-5e7c-4476-9e0a-b35259179b3b admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:41.813021 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4894404-3ab0-47ed-9f25-1058b99c0d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.813795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4894404-3ab0-47ed-9f25-1058b99c0d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.814079 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4894404-3ab0-47ed-9f25-1058b99c0d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.814353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4894404-3ab0-47ed-9f25-1058b99c0d04 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.821455 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4894404-3ab0-47ed-9f25-1058b99c0d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.825213 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4894404-3ab0-47ed-9f25-1058b99c0d04 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:41.860122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1114/2227] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:41 2022] POST /identity/v3/users => generated 282 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:41.861731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febd9f-e66d-4771-95a1-6a4812184361 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:41.873692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febd9f-e66d-4771-95a1-6a4812184361 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:41.881177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c3d92-48a2-4612-a3d5-bfbaa01845aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.881872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c3d92-48a2-4612-a3d5-bfbaa01845aa admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.882304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c3d92-48a2-4612-a3d5-bfbaa01845aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.882696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c3d92-48a2-4612-a3d5-bfbaa01845aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.883502 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c3d92-48a2-4612-a3d5-bfbaa01845aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.886367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c3d92-48a2-4612-a3d5-bfbaa01845aa admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:41.898629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1114/2228] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:41.903533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4894404-3ab0-47ed-9f25-1058b99c0d04 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:41.919996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4894404-3ab0-47ed-9f25-1058b99c0d04 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:41.925461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741e25-920e-4bb6-9b8b-9d77f5b97058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.926664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741e25-920e-4bb6-9b8b-9d77f5b97058 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.926946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741e25-920e-4bb6-9b8b-9d77f5b97058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.927322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741e25-920e-4bb6-9b8b-9d77f5b97058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.927960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741e25-920e-4bb6-9b8b-9d77f5b97058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.929586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741e25-920e-4bb6-9b8b-9d77f5b97058 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:41.945996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1115/2229] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:41.947681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c3d92-48a2-4612-a3d5-bfbaa01845aa admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:41.958648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c3d92-48a2-4612-a3d5-bfbaa01845aa admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:41.965447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb43143-e803-4c52-905e-5cb3a910d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:41.966166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb43143-e803-4c52-905e-5cb3a910d224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:41.966444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb43143-e803-4c52-905e-5cb3a910d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:41.966815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb43143-e803-4c52-905e-5cb3a910d224 admin admin] PATH_INFO: `/v3/projects/671ad8384c3d4476a349b23155d5f3df/users/434797676ed34891873ebe95361805a0/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:41.985354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb43143-e803-4c52-905e-5cb3a910d224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671ad8384c3d4476a349b23155d5f3df, user_id=434797676ed34891873ebe95361805a0, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:41.988236 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb43143-e803-4c52-905e-5cb3a910d224 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:42.002356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1115/2230] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:41 2022] PUT /identity/v3/projects/671ad8384c3d4476a349b23155d5f3df/users/434797676ed34891873ebe95361805a0/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:42.013587 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f468be-84dd-4c26-a783-9a57ce0596ab None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:42.013870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f468be-84dd-4c26-a783-9a57ce0596ab None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:42.014139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f468be-84dd-4c26-a783-9a57ce0596ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:42.044809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-e6f468be-84dd-4c26-a783-9a57ce0596ab None None] MFA Rules not processed for user `434797676ed34891873ebe95361805a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:42.046082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e6f468be-84dd-4c26-a783-9a57ce0596ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:42.118115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1116/2231] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:42.130194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb43143-e803-4c52-905e-5cb3a910d224 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:42.132027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ebb43143-e803-4c52-905e-5cb3a910d224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:42.202458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb43143-e803-4c52-905e-5cb3a910d224 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:42.206492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ae5a-8d3e-46e4-9942-fbaaf16b9e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:42.207176 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ae5a-8d3e-46e4-9942-fbaaf16b9e23 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:42.207479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ae5a-8d3e-46e4-9942-fbaaf16b9e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:42.207823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ae5a-8d3e-46e4-9942-fbaaf16b9e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:42.215475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:42.218850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8ae5a-8d3e-46e4-9942-fbaaf16b9e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:42.219772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8ae5a-8d3e-46e4-9942-fbaaf16b9e23 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:42.232877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1116/2232] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:42.419413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f468be-84dd-4c26-a783-9a57ce0596ab None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:42.421196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e6f468be-84dd-4c26-a783-9a57ce0596ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:42.445638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f468be-84dd-4c26-a783-9a57ce0596ab None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:42.454909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ae5a-8d3e-46e4-9942-fbaaf16b9e23 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:42.456937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a6f8ae5a-8d3e-46e4-9942-fbaaf16b9e23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:42.460805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23026562-61e0-490d-bccb-8d748c169f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:42.462439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23026562-61e0-490d-bccb-8d748c169f4d service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:42.464231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23026562-61e0-490d-bccb-8d748c169f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:42.468675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23026562-61e0-490d-bccb-8d748c169f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:42.480047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-23026562-61e0-490d-bccb-8d748c169f4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:42.572798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23026562-61e0-490d-bccb-8d748c169f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:42.574977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23026562-61e0-490d-bccb-8d748c169f4d service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:42.587659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1117/2233] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:42.611401 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ae5a-8d3e-46e4-9942-fbaaf16b9e23 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:42.618099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:42.618775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:42.619056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:42.619329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] PATH_INFO: `/v3/projects/b44f5c305ad14100b0cba168b7d68a0a` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:42.620817 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44f5c305ad14100b0cba168b7d68a0a)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:42.622796 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:42.725516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44f5c305ad14100b0cba168b7d68a0a', 'request_id': 'req-e13d4423-553f-4b3f-9697-2007ac6e530c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:42.734334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44f5c305ad14100b0cba168b7d68a0a', 'request_id': 'req-e13d4423-553f-4b3f-9697-2007ac6e530c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:42.755225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44f5c305ad14100b0cba168b7d68a0a', 'request_id': 'req-e13d4423-553f-4b3f-9697-2007ac6e530c'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:42.774885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] The token cache is being invalidate because project b44f5c305ad14100b0cba168b7d68a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:42.775929 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:42.776798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e13d4423-553f-4b3f-9697-2007ac6e530c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:42.778444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1117/2234] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:42 2022] DELETE /identity/v3/projects/b44f5c305ad14100b0cba168b7d68a0a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:42.783628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd709d-c945-453a-bd9c-0ada3bb269de None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:42.784264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd709d-c945-453a-bd9c-0ada3bb269de None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:42.785011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd709d-c945-453a-bd9c-0ada3bb269de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:42.826925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c6cd709d-c945-453a-bd9c-0ada3bb269de None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:42.828768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c6cd709d-c945-453a-bd9c-0ada3bb269de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:42.894101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:42.941129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1118/2235] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:42.946047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b4ea-2318-415d-83ee-0b8005bcf777 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:42.946482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b4ea-2318-415d-83ee-0b8005bcf777 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:42.946652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b4ea-2318-415d-83ee-0b8005bcf777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:42.971416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3428b4ea-2318-415d-83ee-0b8005bcf777 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:42.972958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3428b4ea-2318-415d-83ee-0b8005bcf777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:42.998114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1118/2236] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:42.998230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd709d-c945-453a-bd9c-0ada3bb269de None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:43.018825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd709d-c945-453a-bd9c-0ada3bb269de None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:43.026233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94975c-7f79-4bfc-9104-7579969d83a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:43.027359 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94975c-7f79-4bfc-9104-7579969d83a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:43.027795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94975c-7f79-4bfc-9104-7579969d83a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:43.028261 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94975c-7f79-4bfc-9104-7579969d83a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:43.029646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94975c-7f79-4bfc-9104-7579969d83a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:43.030152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94975c-7f79-4bfc-9104-7579969d83a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:43.032654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94975c-7f79-4bfc-9104-7579969d83a2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:43.051404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1119/2237] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:22:43.052350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428b4ea-2318-415d-83ee-0b8005bcf777 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:43.071798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428b4ea-2318-415d-83ee-0b8005bcf777 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:43.081274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22969301-98c7-43b4-b277-b07a0acaecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:43.081978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22969301-98c7-43b4-b277-b07a0acaecdb admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:43.082253 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22969301-98c7-43b4-b277-b07a0acaecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:43.082520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22969301-98c7-43b4-b277-b07a0acaecdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:43.083197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22969301-98c7-43b4-b277-b07a0acaecdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:43.085735 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22969301-98c7-43b4-b277-b07a0acaecdb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:43.128909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1119/2238] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:43 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:43.133639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94975c-7f79-4bfc-9104-7579969d83a2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:43.145820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94975c-7f79-4bfc-9104-7579969d83a2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:43.248166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb919f5-08fe-4b82-a3b1-72edf9c8153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:43.248581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb919f5-08fe-4b82-a3b1-72edf9c8153a admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:43.248901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb919f5-08fe-4b82-a3b1-72edf9c8153a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:43.249220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb919f5-08fe-4b82-a3b1-72edf9c8153a admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:43.249862 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb919f5-08fe-4b82-a3b1-72edf9c8153a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:43.251863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb919f5-08fe-4b82-a3b1-72edf9c8153a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:43.280769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22969301-98c7-43b4-b277-b07a0acaecdb admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:43.281253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1120/2239] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:43 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:43.293284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22969301-98c7-43b4-b277-b07a0acaecdb admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:43.298625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06564673-8c60-42bb-af1f-5c114ef953f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:43.299326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564673-8c60-42bb-af1f-5c114ef953f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:43.299671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564673-8c60-42bb-af1f-5c114ef953f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:43.300190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564673-8c60-42bb-af1f-5c114ef953f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:43.301233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06564673-8c60-42bb-af1f-5c114ef953f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:43.303325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06564673-8c60-42bb-af1f-5c114ef953f5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:43.343455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1120/2240] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:43.344842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb919f5-08fe-4b82-a3b1-72edf9c8153a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:43.358051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb919f5-08fe-4b82-a3b1-72edf9c8153a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:43.385433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c38ec-3e1c-402c-9d9f-72d59c0fcc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:43.386301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c38ec-3e1c-402c-9d9f-72d59c0fcc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:43.386500 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c38ec-3e1c-402c-9d9f-72d59c0fcc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:43.386782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c38ec-3e1c-402c-9d9f-72d59c0fcc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:43.387414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c38ec-3e1c-402c-9d9f-72d59c0fcc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:43.389146 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c38ec-3e1c-402c-9d9f-72d59c0fcc89 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:43.414913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06564673-8c60-42bb-af1f-5c114ef953f5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:43.423353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1121/2241] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:43.435217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06564673-8c60-42bb-af1f-5c114ef953f5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:43.454705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f334-f99d-401d-9ce5-eaed71825658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:43.455532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f334-f99d-401d-9ce5-eaed71825658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:43.456067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f334-f99d-401d-9ce5-eaed71825658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:43.456407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f334-f99d-401d-9ce5-eaed71825658 admin admin] PATH_INFO: `/v3/projects/394a98284f6040eca28477f9f79af9b9/users/d02a1df4cd014f78b6fc33082c577275/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:43.482209 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1f334-f99d-401d-9ce5-eaed71825658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394a98284f6040eca28477f9f79af9b9, user_id=d02a1df4cd014f78b6fc33082c577275, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:43.485330 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1f334-f99d-401d-9ce5-eaed71825658 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:43.505011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1121/2242] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:43 2022] PUT /identity/v3/projects/394a98284f6040eca28477f9f79af9b9/users/d02a1df4cd014f78b6fc33082c577275/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:43.516997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb48d1-3f00-4a2c-8745-9fde69aa8263 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:43.517518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb48d1-3f00-4a2c-8745-9fde69aa8263 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:43.517991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb48d1-3f00-4a2c-8745-9fde69aa8263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:43.557591 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-debb48d1-3f00-4a2c-8745-9fde69aa8263 None None] MFA Rules not processed for user `d02a1df4cd014f78b6fc33082c577275`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:43.560332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-debb48d1-3f00-4a2c-8745-9fde69aa8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:43.647597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1122/2243] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:43.658473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f334-f99d-401d-9ce5-eaed71825658 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:43.660216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-74d1f334-f99d-401d-9ce5-eaed71825658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:43.707695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:43.780385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f334-f99d-401d-9ce5-eaed71825658 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:43.785488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c4027-714f-4a86-aa8b-9aae65d34ec2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79efccae1afa46e78c25f617bf2dd9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:43.786488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c4027-714f-4a86-aa8b-9aae65d34ec2 service glance] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:43.786945 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c4027-714f-4a86-aa8b-9aae65d34ec2 service glance] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:43.787798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c4027-714f-4a86-aa8b-9aae65d34ec2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:43.814159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c4027-714f-4a86-aa8b-9aae65d34ec2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:43.818809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c4027-714f-4a86-aa8b-9aae65d34ec2 service glance] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:43.842169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1122/2244] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:46.422462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb48d1-3f00-4a2c-8745-9fde69aa8263 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:46.424060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-debb48d1-3f00-4a2c-8745-9fde69aa8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:46.485723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:46.523138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb48d1-3f00-4a2c-8745-9fde69aa8263 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:46.531559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:46.534267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:46.534905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:46.535364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] PATH_INFO: `/v3/users/f3feb22d1b1e40f5baaffb2d15f9577e` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:46.537863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3feb22d1b1e40f5baaffb2d15f9577e)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:46.541534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:46.620733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3feb22d1b1e40f5baaffb2d15f9577e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:46.633406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3feb22d1b1e40f5baaffb2d15f9577e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:46.638601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3feb22d1b1e40f5baaffb2d15f9577e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:46.640848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3feb22d1b1e40f5baaffb2d15f9577e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:46.656932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3feb22d1b1e40f5baaffb2d15f9577e'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:46.694001 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1123/2245] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:46 2022] DELETE /identity/v3/users/f3feb22d1b1e40f5baaffb2d15f9577e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:46.694232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa568c2a-c857-498b-ad3e-009371c499b9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:46.694232 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa568c2a-c857-498b-ad3e-009371c499b9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:46.694776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa568c2a-c857-498b-ad3e-009371c499b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:46.715504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fa568c2a-c857-498b-ad3e-009371c499b9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:46.716758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fa568c2a-c857-498b-ad3e-009371c499b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:46.825777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1123/2246] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:46.836704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:46.839044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:46.979089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3497e93-bcc0-43e1-a933-7d5c46d09280 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:46.984536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58d76d-d206-4ea6-bfaa-77b01ad8f09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:46.985434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d76d-d206-4ea6-bfaa-77b01ad8f09a service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:46.985768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d76d-d206-4ea6-bfaa-77b01ad8f09a service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:46.986049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d76d-d206-4ea6-bfaa-77b01ad8f09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:47.002045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58d76d-d206-4ea6-bfaa-77b01ad8f09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:47.004963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58d76d-d206-4ea6-bfaa-77b01ad8f09a service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:47.022244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1124/2247] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:47.511660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa568c2a-c857-498b-ad3e-009371c499b9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:47.514324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fa568c2a-c857-498b-ad3e-009371c499b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:47.551717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa568c2a-c857-498b-ad3e-009371c499b9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:47.581095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:47.581848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:47.583384 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:47.584408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] PATH_INFO: `/v3/projects/9d3dfcea95084e189f7a4ba9bca944c7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:47.589173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3dfcea95084e189f7a4ba9bca944c7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:47.605800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:47.672911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3dfcea95084e189f7a4ba9bca944c7', 'request_id': 'req-2fa17576-d762-48d5-bf5e-b92abc856b43'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:47.681542 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3dfcea95084e189f7a4ba9bca944c7', 'request_id': 'req-2fa17576-d762-48d5-bf5e-b92abc856b43'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:47.725458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3dfcea95084e189f7a4ba9bca944c7', 'request_id': 'req-2fa17576-d762-48d5-bf5e-b92abc856b43'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:47.756233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] The token cache is being invalidate because project 9d3dfcea95084e189f7a4ba9bca944c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:47.757125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:47.758688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2fa17576-d762-48d5-bf5e-b92abc856b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:47.764826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1124/2248] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:47 2022] DELETE /identity/v3/projects/9d3dfcea95084e189f7a4ba9bca944c7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:47.766052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58d76d-d206-4ea6-bfaa-77b01ad8f09a service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:47.781943 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58d76d-d206-4ea6-bfaa-77b01ad8f09a service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:47.953312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:47.980288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:47.981119 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:47.985225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:47.985505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] PATH_INFO: `/v3/users/5e046ef204bc417298633fd807b4fe59` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:47.987051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e046ef204bc417298633fd807b4fe59)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:47.991490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:48.134350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e046ef204bc417298633fd807b4fe59'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:48.161018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e046ef204bc417298633fd807b4fe59'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:48.161018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e046ef204bc417298633fd807b4fe59'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:48.161018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e046ef204bc417298633fd807b4fe59'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:48.168109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9e99d-704f-439e-bcfa-0d9f423d85bc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:48.168614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9e99d-704f-439e-bcfa-0d9f423d85bc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:48.169053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9e99d-704f-439e-bcfa-0d9f423d85bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:48.188036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e046ef204bc417298633fd807b4fe59'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:48.241669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1125/2249] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:47 2022] DELETE /identity/v3/users/5e046ef204bc417298633fd807b4fe59 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:48.252953 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-92f9e99d-704f-439e-bcfa-0d9f423d85bc None None] MFA Rules not processed for user `d401f4d03dfc4391af76a99c91eb37e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:48.254383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-92f9e99d-704f-439e-bcfa-0d9f423d85bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:48.321399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:48.358551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1125/2250] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:48.374726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:48.376883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:48.539421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fe6c2-3c74-4c2e-bcbd-018abf285927 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:48.547280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7f7c2-d1a7-4eb4-b4ee-a65d0cba1e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:48.547919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f7c2-d1a7-4eb4-b4ee-a65d0cba1e9d service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:48.548264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f7c2-d1a7-4eb4-b4ee-a65d0cba1e9d service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:48.548544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f7c2-d1a7-4eb4-b4ee-a65d0cba1e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:48.560866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7f7c2-d1a7-4eb4-b4ee-a65d0cba1e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:48.563375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7f7c2-d1a7-4eb4-b4ee-a65d0cba1e9d service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:48.575967 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1126/2251] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:48.638275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9e99d-704f-439e-bcfa-0d9f423d85bc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:48.641024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-92f9e99d-704f-439e-bcfa-0d9f423d85bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:48.762563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9e99d-704f-439e-bcfa-0d9f423d85bc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:48.767548 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:48.768419 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:48.769032 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:48.769326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] PATH_INFO: `/v3/projects/d60fccfd43c848d38a986e3a430b9fbd` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:48.771029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60fccfd43c848d38a986e3a430b9fbd)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:48.773398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:48.843137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60fccfd43c848d38a986e3a430b9fbd', 'request_id': 'req-aa081ead-d3b2-4f47-bcd2-509d4b97b603'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:48.857935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60fccfd43c848d38a986e3a430b9fbd', 'request_id': 'req-aa081ead-d3b2-4f47-bcd2-509d4b97b603'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:48.870236 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60fccfd43c848d38a986e3a430b9fbd', 'request_id': 'req-aa081ead-d3b2-4f47-bcd2-509d4b97b603'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:48.886852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] The token cache is being invalidate because project d60fccfd43c848d38a986e3a430b9fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:48.887375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:48.888139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-aa081ead-d3b2-4f47-bcd2-509d4b97b603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:48.890687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1126/2252] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:48 2022] DELETE /identity/v3/projects/d60fccfd43c848d38a986e3a430b9fbd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:48.895956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b664a-802e-4bb1-ac2a-f2054dd74407 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:48.896976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b664a-802e-4bb1-ac2a-f2054dd74407 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:48.897258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b664a-802e-4bb1-ac2a-f2054dd74407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:48.941756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-154b664a-802e-4bb1-ac2a-f2054dd74407 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:48.941756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-154b664a-802e-4bb1-ac2a-f2054dd74407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:49.057931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1127/2253] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:49.069870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999985d-a1fd-4e68-918e-fae66d24541c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:49.070214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999985d-a1fd-4e68-918e-fae66d24541c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:49.070946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999985d-a1fd-4e68-918e-fae66d24541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:49.135018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-1999985d-a1fd-4e68-918e-fae66d24541c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:49.149088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1999985d-a1fd-4e68-918e-fae66d24541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:49.178171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1127/2254] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:49.182220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b664a-802e-4bb1-ac2a-f2054dd74407 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:49.192993 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:49.220479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b664a-802e-4bb1-ac2a-f2054dd74407 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:49.227156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57369d32-bad8-4de4-8aaf-567bf611fff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:49.228688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369d32-bad8-4de4-8aaf-567bf611fff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:49.229243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369d32-bad8-4de4-8aaf-567bf611fff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:49.229695 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369d32-bad8-4de4-8aaf-567bf611fff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:49.230994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57369d32-bad8-4de4-8aaf-567bf611fff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:49.231475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57369d32-bad8-4de4-8aaf-567bf611fff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:49.233562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57369d32-bad8-4de4-8aaf-567bf611fff0 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:49.274282 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1128/2255] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:49.277121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999985d-a1fd-4e68-918e-fae66d24541c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:49.287123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999985d-a1fd-4e68-918e-fae66d24541c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:49.332542 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b077c9-259d-40f1-a9e8-1c75d502cb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:49.333141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b077c9-259d-40f1-a9e8-1c75d502cb27 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:49.333422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b077c9-259d-40f1-a9e8-1c75d502cb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:49.333691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b077c9-259d-40f1-a9e8-1c75d502cb27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:49.334329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b077c9-259d-40f1-a9e8-1c75d502cb27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:49.345159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b077c9-259d-40f1-a9e8-1c75d502cb27 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:49.447721 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1128/2256] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:49 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:49.457217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57369d32-bad8-4de4-8aaf-567bf611fff0 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:49.484873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57369d32-bad8-4de4-8aaf-567bf611fff0 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:49.617382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ca0e7-965e-476f-94c1-f639b515f999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:49.618066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ca0e7-965e-476f-94c1-f639b515f999 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:49.618351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ca0e7-965e-476f-94c1-f639b515f999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:49.619329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ca0e7-965e-476f-94c1-f639b515f999 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:49.621466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ca0e7-965e-476f-94c1-f639b515f999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:49.623482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ca0e7-965e-476f-94c1-f639b515f999 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:49.667136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1129/2257] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:49 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:49.667690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b077c9-259d-40f1-a9e8-1c75d502cb27 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:49.681864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b077c9-259d-40f1-a9e8-1c75d502cb27 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:49.689078 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd4c91-a4fd-4c63-80a9-960eccc69bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:49.689930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd4c91-a4fd-4c63-80a9-960eccc69bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:49.690178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd4c91-a4fd-4c63-80a9-960eccc69bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:49.690640 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd4c91-a4fd-4c63-80a9-960eccc69bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:49.691455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd4c91-a4fd-4c63-80a9-960eccc69bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:49.693226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd4c91-a4fd-4c63-80a9-960eccc69bb3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:49.706986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1129/2258] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:49.711745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ca0e7-965e-476f-94c1-f639b515f999 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:49.724233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ca0e7-965e-476f-94c1-f639b515f999 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:49.740871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc035c3f-c020-4912-8116-69fd61ac3659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:49.741548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035c3f-c020-4912-8116-69fd61ac3659 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:49.742053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035c3f-c020-4912-8116-69fd61ac3659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:49.742053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035c3f-c020-4912-8116-69fd61ac3659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:49.742856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc035c3f-c020-4912-8116-69fd61ac3659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:49.747954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc035c3f-c020-4912-8116-69fd61ac3659 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:49.765563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1130/2259] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:49.769155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd4c91-a4fd-4c63-80a9-960eccc69bb3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:49.792265 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd4c91-a4fd-4c63-80a9-960eccc69bb3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:49.797766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa6ee9-e6bb-49fc-83ab-05d87e9f63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:49.798868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa6ee9-e6bb-49fc-83ab-05d87e9f63a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:49.799296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa6ee9-e6bb-49fc-83ab-05d87e9f63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:49.799714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa6ee9-e6bb-49fc-83ab-05d87e9f63a1 admin admin] PATH_INFO: `/v3/projects/b9982c721fe740dd8fe4f25155543003/users/d5226fcf79f54c588a1278a3765ead84/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:49.828512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa6ee9-e6bb-49fc-83ab-05d87e9f63a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9982c721fe740dd8fe4f25155543003, user_id=d5226fcf79f54c588a1278a3765ead84, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:49.837915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa6ee9-e6bb-49fc-83ab-05d87e9f63a1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:49.865409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1130/2260] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:49 2022] PUT /identity/v3/projects/b9982c721fe740dd8fe4f25155543003/users/d5226fcf79f54c588a1278a3765ead84/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:49.870221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74741067-5a5d-4577-94b6-6760b19758fd None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:49.870511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74741067-5a5d-4577-94b6-6760b19758fd None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:49.870782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74741067-5a5d-4577-94b6-6760b19758fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:49.911901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-74741067-5a5d-4577-94b6-6760b19758fd None None] MFA Rules not processed for user `d5226fcf79f54c588a1278a3765ead84`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:49.913238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-74741067-5a5d-4577-94b6-6760b19758fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:50.007568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1131/2261] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:50.030466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa6ee9-e6bb-49fc-83ab-05d87e9f63a1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:50.032653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a0aa6ee9-e6bb-49fc-83ab-05d87e9f63a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:50.040591 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:50.116120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa6ee9-e6bb-49fc-83ab-05d87e9f63a1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:50.120534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d2835-7246-49df-b0ff-6cda8947c4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:50.121289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d2835-7246-49df-b0ff-6cda8947c4ae service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:50.121635 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d2835-7246-49df-b0ff-6cda8947c4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:50.122052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d2835-7246-49df-b0ff-6cda8947c4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:50.134404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d2835-7246-49df-b0ff-6cda8947c4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:50.136487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d2835-7246-49df-b0ff-6cda8947c4ae service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:50.146726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1131/2262] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:50.540830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9bd96-7dc3-4071-a29e-3e53ac37bca7 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:50.540830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9bd96-7dc3-4071-a29e-3e53ac37bca7 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:50.542004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d2835-7246-49df-b0ff-6cda8947c4ae service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:50.542577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9bd96-7dc3-4071-a29e-3e53ac37bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:50.543420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d13d2835-7246-49df-b0ff-6cda8947c4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:50.585140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-7ae9bd96-7dc3-4071-a29e-3e53ac37bca7 None None] MFA Rules not processed for user `d401f4d03dfc4391af76a99c91eb37e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:50.589763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-7ae9bd96-7dc3-4071-a29e-3e53ac37bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:50.662026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d2835-7246-49df-b0ff-6cda8947c4ae service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:50.680003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:50.680776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:50.681173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:50.681620 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] PATH_INFO: `/v3/users/09a6264b7c414946b706f1b19695744f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:50.682904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a6264b7c414946b706f1b19695744f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:50.684853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:50.688132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1132/2263] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:50.792962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a6264b7c414946b706f1b19695744f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.809691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a6264b7c414946b706f1b19695744f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.813162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a6264b7c414946b706f1b19695744f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.813792 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a6264b7c414946b706f1b19695744f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.831391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a6264b7c414946b706f1b19695744f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.856100 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1132/2264] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:50 2022] DELETE /identity/v3/users/09a6264b7c414946b706f1b19695744f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:50.858775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b1f3-87b1-49be-9a88-6af1b718555c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:50.859065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b1f3-87b1-49be-9a88-6af1b718555c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:50.859340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b1f3-87b1-49be-9a88-6af1b718555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:50.869772 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:50.898071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c270b1f3-87b1-49be-9a88-6af1b718555c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:50.898071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c270b1f3-87b1-49be-9a88-6af1b718555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:50.977241 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1133/2265] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:50.987759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:50.989647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:51.064647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:51.142393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e6c71-42b7-451e-a405-9ff52fbc7550 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:51.146951 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337c7a-01b4-49b1-8a2a-e027e35040be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:51.148320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337c7a-01b4-49b1-8a2a-e027e35040be service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:51.148599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337c7a-01b4-49b1-8a2a-e027e35040be service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:51.149009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337c7a-01b4-49b1-8a2a-e027e35040be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:51.170654 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0337c7a-01b4-49b1-8a2a-e027e35040be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:51.173739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0337c7a-01b4-49b1-8a2a-e027e35040be service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:51.190471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1133/2266] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:51.679154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270b1f3-87b1-49be-9a88-6af1b718555c None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:51.682269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c270b1f3-87b1-49be-9a88-6af1b718555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:51.717143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270b1f3-87b1-49be-9a88-6af1b718555c None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:51.730850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:51.731742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:51.732172 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:51.732540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] PATH_INFO: `/v3/projects/2a7d3109b17a4c01a84ab6083e29c3f8` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:51.733998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7d3109b17a4c01a84ab6083e29c3f8)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:51.736591 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:51.808501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7d3109b17a4c01a84ab6083e29c3f8', 'request_id': 'req-bef000a2-cd2d-493b-97bb-0506f0488600'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.818236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7d3109b17a4c01a84ab6083e29c3f8', 'request_id': 'req-bef000a2-cd2d-493b-97bb-0506f0488600'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.837038 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7d3109b17a4c01a84ab6083e29c3f8', 'request_id': 'req-bef000a2-cd2d-493b-97bb-0506f0488600'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.850723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] The token cache is being invalidate because project 2a7d3109b17a4c01a84ab6083e29c3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:51.851085 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.851787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.872026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1134/2267] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:51 2022] DELETE /identity/v3/projects/2a7d3109b17a4c01a84ab6083e29c3f8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:55.979246 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337c7a-01b4-49b1-8a2a-e027e35040be service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.980801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e0337c7a-01b4-49b1-8a2a-e027e35040be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.000184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337c7a-01b4-49b1-8a2a-e027e35040be service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.079072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.079808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.080154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.080506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] PATH_INFO: `/v3/users/b2aa64efbefa4e64ab53a80d0a75bc93` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.081703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2aa64efbefa4e64ab53a80d0a75bc93)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.083768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.143717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.145733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.163009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2aa64efbefa4e64ab53a80d0a75bc93'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.163873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef000a2-cd2d-493b-97bb-0506f0488600 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.171272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.171928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.172938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.173214 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] PATH_INFO: `/v3/users/d5226fcf79f54c588a1278a3765ead84` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.175847 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5226fcf79f54c588a1278a3765ead84)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.177296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2aa64efbefa4e64ab53a80d0a75bc93'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.177664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2aa64efbefa4e64ab53a80d0a75bc93'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.177911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.178432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2aa64efbefa4e64ab53a80d0a75bc93'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.189914 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-b10d1091-92da-4339-91fb-1710a93b4910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2aa64efbefa4e64ab53a80d0a75bc93'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.218982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1134/2268] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:55 2022] DELETE /identity/v3/users/b2aa64efbefa4e64ab53a80d0a75bc93 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:56.222123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a24a6-5325-474b-9557-cf3c507b0adb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.222562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a24a6-5325-474b-9557-cf3c507b0adb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.222866 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a24a6-5325-474b-9557-cf3c507b0adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.243944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3e1a24a6-5325-474b-9557-cf3c507b0adb None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:56.245416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3e1a24a6-5325-474b-9557-cf3c507b0adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.245736 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5226fcf79f54c588a1278a3765ead84'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.258704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5226fcf79f54c588a1278a3765ead84'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.259970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5226fcf79f54c588a1278a3765ead84'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.260577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5226fcf79f54c588a1278a3765ead84'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.282853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07d37ac2-fbcc-4e65-9d9d-37395499f229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5226fcf79f54c588a1278a3765ead84'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.307230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:56.314069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1135/2269] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:56 2022] DELETE /identity/v3/users/d5226fcf79f54c588a1278a3765ead84 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:56.319854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949fe97-6284-4cf7-af83-3059edd4e090 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.320523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949fe97-6284-4cf7-af83-3059edd4e090 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.321003 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949fe97-6284-4cf7-af83-3059edd4e090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.331610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:56.355216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1135/2270] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:56.356781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9949fe97-6284-4cf7-af83-3059edd4e090 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:56.361319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9949fe97-6284-4cf7-af83-3059edd4e090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.364954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a24a6-5325-474b-9557-cf3c507b0adb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.366379 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3e1a24a6-5325-474b-9557-cf3c507b0adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.483248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1136/2271] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:56.492166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949fe97-6284-4cf7-af83-3059edd4e090 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.494350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9949fe97-6284-4cf7-af83-3059edd4e090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.530672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a24a6-5325-474b-9557-cf3c507b0adb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.625166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949fe97-6284-4cf7-af83-3059edd4e090 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.633422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca6b9f-e6a1-454f-a40d-4931ade297b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.635533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca6b9f-e6a1-454f-a40d-4931ade297b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.636033 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca6b9f-e6a1-454f-a40d-4931ade297b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.636486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca6b9f-e6a1-454f-a40d-4931ade297b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.638169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c2aca-d4ef-4467-8156-1f785c26a5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.638811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c2aca-d4ef-4467-8156-1f785c26a5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.639088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c2aca-d4ef-4467-8156-1f785c26a5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.639362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c2aca-d4ef-4467-8156-1f785c26a5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.659700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca6b9f-e6a1-454f-a40d-4931ade297b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.661467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca6b9f-e6a1-454f-a40d-4931ade297b5 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.679963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c2aca-d4ef-4467-8156-1f785c26a5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.683697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c2aca-d4ef-4467-8156-1f785c26a5b5 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.707849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1137/2272] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:56.714297 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1136/2273] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:57.485507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca6b9f-e6a1-454f-a40d-4931ade297b5 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.487536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3fca6b9f-e6a1-454f-a40d-4931ade297b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.511571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca6b9f-e6a1-454f-a40d-4931ade297b5 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.526705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.536246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.536805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.537745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] PATH_INFO: `/v3/projects/b9982c721fe740dd8fe4f25155543003` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.539829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9982c721fe740dd8fe4f25155543003)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.542185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.551150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c2aca-d4ef-4467-8156-1f785c26a5b5 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.553425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-465c2aca-d4ef-4467-8156-1f785c26a5b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.572291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c2aca-d4ef-4467-8156-1f785c26a5b5 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.590348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.591325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.591791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.592738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] PATH_INFO: `/v3/projects/26cdd781fce645c8a44ccceadaaba9db` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.594890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cdd781fce645c8a44ccceadaaba9db)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.604788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.637503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9982c721fe740dd8fe4f25155543003', 'request_id': 'req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.644577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9982c721fe740dd8fe4f25155543003', 'request_id': 'req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.652671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9982c721fe740dd8fe4f25155543003', 'request_id': 'req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.659913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cdd781fce645c8a44ccceadaaba9db', 'request_id': 'req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.666460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] The token cache is being invalidate because project b9982c721fe740dd8fe4f25155543003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:57.666709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cdd781fce645c8a44ccceadaaba9db', 'request_id': 'req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.666816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.667392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5e7c1e3-838b-432f-8e2c-bb73485bfc14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.669297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1138/2274] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:57 2022] DELETE /identity/v3/projects/b9982c721fe740dd8fe4f25155543003 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:57.674479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094ead-f58d-4049-9fa0-aeb173fdbf5c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.674776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094ead-f58d-4049-9fa0-aeb173fdbf5c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.675059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094ead-f58d-4049-9fa0-aeb173fdbf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.679806 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cdd781fce645c8a44ccceadaaba9db', 'request_id': 'req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.694276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] The token cache is being invalidate because project 26cdd781fce645c8a44ccceadaaba9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:57.694451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.695256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-4a386ec4-ab86-4604-8e9a-06dff3c4e42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.697693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1137/2275] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:57 2022] DELETE /identity/v3/projects/26cdd781fce645c8a44ccceadaaba9db => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:57.702640 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64906cc-b012-4028-b9ff-b5e4d380a32c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.702911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64906cc-b012-4028-b9ff-b5e4d380a32c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.703120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64906cc-b012-4028-b9ff-b5e4d380a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.706830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-1c094ead-f58d-4049-9fa0-aeb173fdbf5c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:57.708132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1c094ead-f58d-4049-9fa0-aeb173fdbf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.726010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d64906cc-b012-4028-b9ff-b5e4d380a32c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:57.727233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d64906cc-b012-4028-b9ff-b5e4d380a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.735469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:57.761863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:57.793918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1139/2276] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:57.802397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c927d92-39c2-4c1d-9e2b-8feedfbdbef9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.802681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c927d92-39c2-4c1d-9e2b-8feedfbdbef9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.803055 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c927d92-39c2-4c1d-9e2b-8feedfbdbef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.805398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1138/2277] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:57.813957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8b5d-446a-42c2-ab81-4d5928e908e5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.814243 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8b5d-446a-42c2-ab81-4d5928e908e5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.814890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8b5d-446a-42c2-ab81-4d5928e908e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.826077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-6c927d92-39c2-4c1d-9e2b-8feedfbdbef9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:57.827316 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-6c927d92-39c2-4c1d-9e2b-8feedfbdbef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.834507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-bd8b8b5d-446a-42c2-ab81-4d5928e908e5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:57.835692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-bd8b8b5d-446a-42c2-ab81-4d5928e908e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.836766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1140/2278] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:57.840465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c927d92-39c2-4c1d-9e2b-8feedfbdbef9 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.851122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c927d92-39c2-4c1d-9e2b-8feedfbdbef9 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.852797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1139/2279] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:57.855490 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b8b5d-446a-42c2-ab81-4d5928e908e5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.858651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3048c-ce20-4278-aaba-ee9f8b9007e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.859269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3048c-ce20-4278-aaba-ee9f8b9007e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.859549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3048c-ce20-4278-aaba-ee9f8b9007e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.859818 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3048c-ce20-4278-aaba-ee9f8b9007e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.860472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3048c-ce20-4278-aaba-ee9f8b9007e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:57.860811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3048c-ce20-4278-aaba-ee9f8b9007e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.862683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3048c-ce20-4278-aaba-ee9f8b9007e3 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.866822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b8b5d-446a-42c2-ab81-4d5928e908e5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.873442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547a1df-2edc-4740-ad5c-e8d3d0ccb93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.874057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a1df-2edc-4740-ad5c-e8d3d0ccb93b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.874337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a1df-2edc-4740-ad5c-e8d3d0ccb93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.874610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a1df-2edc-4740-ad5c-e8d3d0ccb93b admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.875260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547a1df-2edc-4740-ad5c-e8d3d0ccb93b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:57.875561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547a1df-2edc-4740-ad5c-e8d3d0ccb93b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.875683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1141/2280] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:22:57.877210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547a1df-2edc-4740-ad5c-e8d3d0ccb93b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.879989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3048c-ce20-4278-aaba-ee9f8b9007e3 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.892121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3048c-ce20-4278-aaba-ee9f8b9007e3 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.895259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1140/2281] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:22:57.901251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547a1df-2edc-4740-ad5c-e8d3d0ccb93b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.903295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5850c8-5ba6-4189-bdfe-9551a98fb967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.905989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5850c8-5ba6-4189-bdfe-9551a98fb967 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.905989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5850c8-5ba6-4189-bdfe-9551a98fb967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.905989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5850c8-5ba6-4189-bdfe-9551a98fb967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.905989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5850c8-5ba6-4189-bdfe-9551a98fb967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.908905 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5850c8-5ba6-4189-bdfe-9551a98fb967 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.912153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547a1df-2edc-4740-ad5c-e8d3d0ccb93b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.918122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e048baf-ff2c-4685-80fa-699c15261499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.918849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e048baf-ff2c-4685-80fa-699c15261499 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.919185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e048baf-ff2c-4685-80fa-699c15261499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.919532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e048baf-ff2c-4685-80fa-699c15261499 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.920226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e048baf-ff2c-4685-80fa-699c15261499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.922320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e048baf-ff2c-4685-80fa-699c15261499 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.964755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1142/2282] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:57 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:57.969346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5850c8-5ba6-4189-bdfe-9551a98fb967 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.975123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1141/2283] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:57 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:57.979592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e048baf-ff2c-4685-80fa-699c15261499 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.082537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e048baf-ff2c-4685-80fa-699c15261499 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.090657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5850c8-5ba6-4189-bdfe-9551a98fb967 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.096450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b254d7-e2d6-4766-be94-e5a70bd17dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.097182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b254d7-e2d6-4766-be94-e5a70bd17dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.097463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b254d7-e2d6-4766-be94-e5a70bd17dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.097736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b254d7-e2d6-4766-be94-e5a70bd17dbb admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.098092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aac3d-628f-4a99-945b-979606ea566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.099474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aac3d-628f-4a99-945b-979606ea566a admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.099586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b254d7-e2d6-4766-be94-e5a70bd17dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.099810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aac3d-628f-4a99-945b-979606ea566a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.100090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aac3d-628f-4a99-945b-979606ea566a admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.101299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812aac3d-628f-4a99-945b-979606ea566a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.102885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812aac3d-628f-4a99-945b-979606ea566a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.104871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b254d7-e2d6-4766-be94-e5a70bd17dbb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.151750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1143/2284] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:57 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:58.153589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1142/2285] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:57 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:58.160174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b254d7-e2d6-4766-be94-e5a70bd17dbb admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.161299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aac3d-628f-4a99-945b-979606ea566a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.180368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b254d7-e2d6-4766-be94-e5a70bd17dbb admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.185478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aac3d-628f-4a99-945b-979606ea566a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.186971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6be8d-dc06-4d17-8192-e4a6fd927155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.188036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6be8d-dc06-4d17-8192-e4a6fd927155 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.188725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6be8d-dc06-4d17-8192-e4a6fd927155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.189319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6be8d-dc06-4d17-8192-e4a6fd927155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.190132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6be8d-dc06-4d17-8192-e4a6fd927155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.193414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741b88f-a190-4ea4-b5f7-7438f5c93f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.194352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b88f-a190-4ea4-b5f7-7438f5c93f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.194720 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b88f-a190-4ea4-b5f7-7438f5c93f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.195019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b88f-a190-4ea4-b5f7-7438f5c93f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.195653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741b88f-a190-4ea4-b5f7-7438f5c93f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.197484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741b88f-a190-4ea4-b5f7-7438f5c93f2d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.201452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6be8d-dc06-4d17-8192-e4a6fd927155 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.218154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1143/2286] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:58.222109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6be8d-dc06-4d17-8192-e4a6fd927155 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.226813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1144/2287] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:58.231025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741b88f-a190-4ea4-b5f7-7438f5c93f2d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.241449 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6be8d-dc06-4d17-8192-e4a6fd927155 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.245364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741b88f-a190-4ea4-b5f7-7438f5c93f2d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.250481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9fabc-40e6-432c-9925-0a8881005872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.250944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fcb3c-d67e-4916-b424-abc7c889e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.251117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9fabc-40e6-432c-9925-0a8881005872 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.251774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9fabc-40e6-432c-9925-0a8881005872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.251883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcb3c-d67e-4916-b424-abc7c889e121 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.251959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9fabc-40e6-432c-9925-0a8881005872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.252040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcb3c-d67e-4916-b424-abc7c889e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.252306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcb3c-d67e-4916-b424-abc7c889e121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.252559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9fabc-40e6-432c-9925-0a8881005872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.253065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fcb3c-d67e-4916-b424-abc7c889e121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.254209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9fabc-40e6-432c-9925-0a8881005872 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.254660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fcb3c-d67e-4916-b424-abc7c889e121 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.271646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1144/2289] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:58.271837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1145/2289] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:58.271956 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fcb3c-d67e-4916-b424-abc7c889e121 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.273109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9fabc-40e6-432c-9925-0a8881005872 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.283247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fcb3c-d67e-4916-b424-abc7c889e121 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.285709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9fabc-40e6-432c-9925-0a8881005872 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.288181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ba05d-2943-4240-ae00-a68e9cc11a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.288943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ba05d-2943-4240-ae00-a68e9cc11a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.289155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ba05d-2943-4240-ae00-a68e9cc11a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.289425 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ba05d-2943-4240-ae00-a68e9cc11a8f admin admin] PATH_INFO: `/v3/projects/93fe502742e348b5a4e6a4751d00bb02/users/75ef260898ff4631bb396a9f5ea2f301/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.291167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6ac3-592c-49a3-8205-7a329a795249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.292051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6ac3-592c-49a3-8205-7a329a795249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.292397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6ac3-592c-49a3-8205-7a329a795249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.292795 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6ac3-592c-49a3-8205-7a329a795249 admin admin] PATH_INFO: `/v3/projects/d6426a79ce2d460595de7e656936224f/users/8d152f781a2f479592e2db34a5a1bdd0/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.308976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ba05d-2943-4240-ae00-a68e9cc11a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fe502742e348b5a4e6a4751d00bb02, user_id=75ef260898ff4631bb396a9f5ea2f301, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.311752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ba05d-2943-4240-ae00-a68e9cc11a8f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.316173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb6ac3-592c-49a3-8205-7a329a795249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6426a79ce2d460595de7e656936224f, user_id=8d152f781a2f479592e2db34a5a1bdd0, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.319569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb6ac3-592c-49a3-8205-7a329a795249 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.338052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1145/2290] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:58 2022] PUT /identity/v3/projects/93fe502742e348b5a4e6a4751d00bb02/users/75ef260898ff4631bb396a9f5ea2f301/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:58.339916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1146/2291] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:58 2022] PUT /identity/v3/projects/d6426a79ce2d460595de7e656936224f/users/8d152f781a2f479592e2db34a5a1bdd0/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:58.340519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11383d6-161d-46f0-a6a6-2605dee63332 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.340834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11383d6-161d-46f0-a6a6-2605dee63332 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.341108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11383d6-161d-46f0-a6a6-2605dee63332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.351422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99650b8-862d-4413-a1ec-20bc4f48e307 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.351704 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99650b8-862d-4413-a1ec-20bc4f48e307 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.351969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99650b8-862d-4413-a1ec-20bc4f48e307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.373755 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e11383d6-161d-46f0-a6a6-2605dee63332 None None] MFA Rules not processed for user `75ef260898ff4631bb396a9f5ea2f301`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:58.375061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e11383d6-161d-46f0-a6a6-2605dee63332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:58.384248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a99650b8-862d-4413-a1ec-20bc4f48e307 None None] MFA Rules not processed for user `8d152f781a2f479592e2db34a5a1bdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:58.385500 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a99650b8-862d-4413-a1ec-20bc4f48e307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:58.406538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:58.407455 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:58.473071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1146/2292] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:58.474622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1147/2293] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:58.487029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11383d6-161d-46f0-a6a6-2605dee63332 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.488818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e11383d6-161d-46f0-a6a6-2605dee63332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:58.489299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99650b8-862d-4413-a1ec-20bc4f48e307 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.491485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a99650b8-862d-4413-a1ec-20bc4f48e307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:58.561229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99650b8-862d-4413-a1ec-20bc4f48e307 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.563716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11383d6-161d-46f0-a6a6-2605dee63332 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.565194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70219e-eb71-4be0-afd8-cdc134c38300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.565792 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70219e-eb71-4be0-afd8-cdc134c38300 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.566073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70219e-eb71-4be0-afd8-cdc134c38300 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.566340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70219e-eb71-4be0-afd8-cdc134c38300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.569289 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10c6a0-cce4-48d8-86e0-ebf98cbccd22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.570112 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c6a0-cce4-48d8-86e0-ebf98cbccd22 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.570583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c6a0-cce4-48d8-86e0-ebf98cbccd22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.571044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c6a0-cce4-48d8-86e0-ebf98cbccd22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.575466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70219e-eb71-4be0-afd8-cdc134c38300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.577173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70219e-eb71-4be0-afd8-cdc134c38300 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.585418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10c6a0-cce4-48d8-86e0-ebf98cbccd22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.587608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10c6a0-cce4-48d8-86e0-ebf98cbccd22 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.587844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1148/2294] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:58.600999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1147/2295] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:01.281195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70219e-eb71-4be0-afd8-cdc134c38300 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:01.354531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70219e-eb71-4be0-afd8-cdc134c38300 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:01.359118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:01.359739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:01.360013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:01.360280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] PATH_INFO: `/v3/users/75ef260898ff4631bb396a9f5ea2f301` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:01.361422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ef260898ff4631bb396a9f5ea2f301)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:01.363344 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:01.415935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ef260898ff4631bb396a9f5ea2f301'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.424827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ef260898ff4631bb396a9f5ea2f301'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.425961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ef260898ff4631bb396a9f5ea2f301'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.426710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ef260898ff4631bb396a9f5ea2f301'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.433941 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:01.436187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ef260898ff4631bb396a9f5ea2f301'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.458508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1149/2296] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:01 2022] DELETE /identity/v3/users/75ef260898ff4631bb396a9f5ea2f301 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:01.463165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce5839-e9e4-4aaa-8b5c-8df85a55d40a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:01.463692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce5839-e9e4-4aaa-8b5c-8df85a55d40a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:01.463867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce5839-e9e4-4aaa-8b5c-8df85a55d40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:01.491255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-79ce5839-e9e4-4aaa-8b5c-8df85a55d40a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:01.492668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-79ce5839-e9e4-4aaa-8b5c-8df85a55d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:01.559158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1148/2297] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:01.568657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:01.570083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:01.630823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac4728-af41-4038-8a63-9f51700d901c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:01.635843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9af8-a443-4666-8e33-ab42e1e9aecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:01.636458 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9af8-a443-4666-8e33-ab42e1e9aecd service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:01.636764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9af8-a443-4666-8e33-ab42e1e9aecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:01.637034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9af8-a443-4666-8e33-ab42e1e9aecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:01.647556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a9af8-a443-4666-8e33-ab42e1e9aecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:01.649085 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a9af8-a443-4666-8e33-ab42e1e9aecd service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:01.659808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1150/2298] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:02.053731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce5839-e9e4-4aaa-8b5c-8df85a55d40a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.055142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-79ce5839-e9e4-4aaa-8b5c-8df85a55d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:02.070013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce5839-e9e4-4aaa-8b5c-8df85a55d40a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.077935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.078589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.078864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.079128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] PATH_INFO: `/v3/projects/93fe502742e348b5a4e6a4751d00bb02` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.080242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93fe502742e348b5a4e6a4751d00bb02)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.082334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.139331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93fe502742e348b5a4e6a4751d00bb02', 'request_id': 'req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.144767 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93fe502742e348b5a4e6a4751d00bb02', 'request_id': 'req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.147338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:02.152609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93fe502742e348b5a4e6a4751d00bb02', 'request_id': 'req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.166066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] The token cache is being invalidate because project 93fe502742e348b5a4e6a4751d00bb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:02.166392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.167071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9d05f8fd-dcd1-4f71-a503-8b5859702a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.168559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1149/2299] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:02 2022] DELETE /identity/v3/projects/93fe502742e348b5a4e6a4751d00bb02 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:02.173399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73b9f8-8fec-4350-97eb-208a99401fae None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.173681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73b9f8-8fec-4350-97eb-208a99401fae None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.173949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73b9f8-8fec-4350-97eb-208a99401fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.194135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-cc73b9f8-8fec-4350-97eb-208a99401fae None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:02.195099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-cc73b9f8-8fec-4350-97eb-208a99401fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:02.261537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1151/2300] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:02.269265 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afc442-cdaa-4819-8153-364889dfd261 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.269541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afc442-cdaa-4819-8153-364889dfd261 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.269835 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afc442-cdaa-4819-8153-364889dfd261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.289726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-24afc442-cdaa-4819-8153-364889dfd261 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:02.291748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-24afc442-cdaa-4819-8153-364889dfd261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:02.299889 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1150/2301] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:02.304363 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73b9f8-8fec-4350-97eb-208a99401fae None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.314544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73b9f8-8fec-4350-97eb-208a99401fae None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.322050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62aa0-f78e-4cd5-b4f3-e46f456d1f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.322598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62aa0-f78e-4cd5-b4f3-e46f456d1f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.322878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62aa0-f78e-4cd5-b4f3-e46f456d1f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.323145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62aa0-f78e-4cd5-b4f3-e46f456d1f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.323912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b62aa0-f78e-4cd5-b4f3-e46f456d1f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:02.324296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b62aa0-f78e-4cd5-b4f3-e46f456d1f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.326226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b62aa0-f78e-4cd5-b4f3-e46f456d1f04 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.352786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1152/2302] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:23:02.354017 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afc442-cdaa-4819-8153-364889dfd261 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.366972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afc442-cdaa-4819-8153-364889dfd261 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.372877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a38f-f326-4ad7-a995-6d1b8496571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.373709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a38f-f326-4ad7-a995-6d1b8496571b admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.374043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a38f-f326-4ad7-a995-6d1b8496571b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.374373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a38f-f326-4ad7-a995-6d1b8496571b admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.375230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651a38f-f326-4ad7-a995-6d1b8496571b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.377318 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651a38f-f326-4ad7-a995-6d1b8496571b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.409748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1151/2303] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:02 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:23:02.416304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62aa0-f78e-4cd5-b4f3-e46f456d1f04 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.434881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62aa0-f78e-4cd5-b4f3-e46f456d1f04 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.501643 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ea7ca-49c5-4ee5-9380-e0687599a319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.502541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ea7ca-49c5-4ee5-9380-e0687599a319 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.502912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ea7ca-49c5-4ee5-9380-e0687599a319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.503290 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ea7ca-49c5-4ee5-9380-e0687599a319 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.504070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ea7ca-49c5-4ee5-9380-e0687599a319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.506798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ea7ca-49c5-4ee5-9380-e0687599a319 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.525617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:02.533204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1153/2304] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:02 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:23:02.536109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a38f-f326-4ad7-a995-6d1b8496571b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.549341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a38f-f326-4ad7-a995-6d1b8496571b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.554279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d852a-f659-4af8-a7de-1b9a84eecb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.554882 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d852a-f659-4af8-a7de-1b9a84eecb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.555160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d852a-f659-4af8-a7de-1b9a84eecb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.555456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d852a-f659-4af8-a7de-1b9a84eecb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.556265 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d852a-f659-4af8-a7de-1b9a84eecb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.557939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d852a-f659-4af8-a7de-1b9a84eecb21 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.580662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1152/2305] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:02.583086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ea7ca-49c5-4ee5-9380-e0687599a319 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.598390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ea7ca-49c5-4ee5-9380-e0687599a319 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.603707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3ab43-171a-4326-a825-ffed78e2add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.604583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3ab43-171a-4326-a825-ffed78e2add3 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.604898 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3ab43-171a-4326-a825-ffed78e2add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.605155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3ab43-171a-4326-a825-ffed78e2add3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.605782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3ab43-171a-4326-a825-ffed78e2add3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.607377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3ab43-171a-4326-a825-ffed78e2add3 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.619549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1154/2306] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:02.622712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d852a-f659-4af8-a7de-1b9a84eecb21 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.634173 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d852a-f659-4af8-a7de-1b9a84eecb21 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.642205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175e2b6-d9f4-4d48-80d9-e33cae65978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.642911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175e2b6-d9f4-4d48-80d9-e33cae65978b admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.643191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175e2b6-d9f4-4d48-80d9-e33cae65978b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.643495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175e2b6-d9f4-4d48-80d9-e33cae65978b admin admin] PATH_INFO: `/v3/projects/9e724bddf8ea447a81793b44af8266af/users/989218c1a1f54a7eb211a49b2c753faf/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.663514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175e2b6-d9f4-4d48-80d9-e33cae65978b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e724bddf8ea447a81793b44af8266af, user_id=989218c1a1f54a7eb211a49b2c753faf, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.666583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175e2b6-d9f4-4d48-80d9-e33cae65978b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.679794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1153/2307] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:02 2022] PUT /identity/v3/projects/9e724bddf8ea447a81793b44af8266af/users/989218c1a1f54a7eb211a49b2c753faf/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:02.685352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889d8ff-135b-4f82-8384-16b58eb7c150 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.685638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889d8ff-135b-4f82-8384-16b58eb7c150 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.685909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889d8ff-135b-4f82-8384-16b58eb7c150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.707922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-0889d8ff-135b-4f82-8384-16b58eb7c150 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:02.709311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0889d8ff-135b-4f82-8384-16b58eb7c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:02.790826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1155/2308] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:02.801079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175e2b6-d9f4-4d48-80d9-e33cae65978b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.802804 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c175e2b6-d9f4-4d48-80d9-e33cae65978b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:02.862959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175e2b6-d9f4-4d48-80d9-e33cae65978b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.866654 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f452fd-d7e7-4976-b7c5-c6a51c8f8b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.867260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f452fd-d7e7-4976-b7c5-c6a51c8f8b92 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.867540 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f452fd-d7e7-4976-b7c5-c6a51c8f8b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.867815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f452fd-d7e7-4976-b7c5-c6a51c8f8b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.879412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f452fd-d7e7-4976-b7c5-c6a51c8f8b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.880871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f452fd-d7e7-4976-b7c5-c6a51c8f8b92 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.892664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1154/2309] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:03.882042 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579951e-dadc-408b-b223-c4d9097a2532 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:03.882476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579951e-dadc-408b-b223-c4d9097a2532 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:03.882476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579951e-dadc-408b-b223-c4d9097a2532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:03.921480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-e579951e-dadc-408b-b223-c4d9097a2532 None None] MFA Rules not processed for user `989218c1a1f54a7eb211a49b2c753faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:03.922739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e579951e-dadc-408b-b223-c4d9097a2532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.020686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1156/2310] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:04.030035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f452fd-d7e7-4976-b7c5-c6a51c8f8b92 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.031632 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-52f452fd-d7e7-4976-b7c5-c6a51c8f8b92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.126544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f452fd-d7e7-4976-b7c5-c6a51c8f8b92 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.130881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76654d2-6da1-4fe6-a596-b34cb6ee7617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.131586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76654d2-6da1-4fe6-a596-b34cb6ee7617 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.131934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76654d2-6da1-4fe6-a596-b34cb6ee7617 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.132265 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76654d2-6da1-4fe6-a596-b34cb6ee7617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.142821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76654d2-6da1-4fe6-a596-b34cb6ee7617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.144310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76654d2-6da1-4fe6-a596-b34cb6ee7617 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.155021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1155/2311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:05.784179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ae14-86bd-425e-bc90-3d0e72c7bb97 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.784741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ae14-86bd-425e-bc90-3d0e72c7bb97 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.785404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ae14-86bd-425e-bc90-3d0e72c7bb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.807357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c611ae14-86bd-425e-bc90-3d0e72c7bb97 None None] MFA Rules not processed for user `989218c1a1f54a7eb211a49b2c753faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:05.808573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c611ae14-86bd-425e-bc90-3d0e72c7bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.815968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1157/2312] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:05.886966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76654d2-6da1-4fe6-a596-b34cb6ee7617 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:05.891939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a76654d2-6da1-4fe6-a596-b34cb6ee7617 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.908347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76654d2-6da1-4fe6-a596-b34cb6ee7617 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:05.913769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:05.914752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.915179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.915595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] PATH_INFO: `/v3/users/d02a1df4cd014f78b6fc33082c577275` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.917037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d02a1df4cd014f78b6fc33082c577275)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:05.919409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:05.959890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:05.997121 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd02a1df4cd014f78b6fc33082c577275'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:06.007816 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd02a1df4cd014f78b6fc33082c577275'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:06.009139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd02a1df4cd014f78b6fc33082c577275'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:06.009873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd02a1df4cd014f78b6fc33082c577275'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:06.021442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd02a1df4cd014f78b6fc33082c577275'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:06.045057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1156/2313] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:05 2022] DELETE /identity/v3/users/d02a1df4cd014f78b6fc33082c577275 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:06.049733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691748b8-28ac-4bca-a182-2e850994a6d5 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.050134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691748b8-28ac-4bca-a182-2e850994a6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.050407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691748b8-28ac-4bca-a182-2e850994a6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.072052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-691748b8-28ac-4bca-a182-2e850994a6d5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:06.073511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-691748b8-28ac-4bca-a182-2e850994a6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:06.151396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1158/2314] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:06.188752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:06.190599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:06.271268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d5253-b96d-498b-801a-d4997ed27f00 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:06.275094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc48ec9-961e-428c-a693-f484ecd2ddcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:06.275766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48ec9-961e-428c-a693-f484ecd2ddcc service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.276043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48ec9-961e-428c-a693-f484ecd2ddcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.276311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48ec9-961e-428c-a693-f484ecd2ddcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.286283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc48ec9-961e-428c-a693-f484ecd2ddcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:06.287741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc48ec9-961e-428c-a693-f484ecd2ddcc service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:06.300218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1157/2315] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:06.850999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691748b8-28ac-4bca-a182-2e850994a6d5 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:06.855153 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-691748b8-28ac-4bca-a182-2e850994a6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:06.913016 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691748b8-28ac-4bca-a182-2e850994a6d5 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:06.923706 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:06.924668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.925171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.926265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] PATH_INFO: `/v3/projects/394a98284f6040eca28477f9f79af9b9` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.955918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] RBAC: Authorizing `identity:delete_project(project_id=394a98284f6040eca28477f9f79af9b9)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:06.959489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:06.986477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=100 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:07.112390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394a98284f6040eca28477f9f79af9b9', 'request_id': 'req-ab0b2a69-3c55-4287-8775-7487cbb061de'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:07.120770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394a98284f6040eca28477f9f79af9b9', 'request_id': 'req-ab0b2a69-3c55-4287-8775-7487cbb061de'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:07.134203 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394a98284f6040eca28477f9f79af9b9', 'request_id': 'req-ab0b2a69-3c55-4287-8775-7487cbb061de'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:07.183243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] The token cache is being invalidate because project 394a98284f6040eca28477f9f79af9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:07.183711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:07.185667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ab0b2a69-3c55-4287-8775-7487cbb061de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:07.190586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1159/2316] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:06 2022] DELETE /identity/v3/projects/394a98284f6040eca28477f9f79af9b9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:07.197347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b62b92-e0c6-4c9b-9640-16210d6df1dc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.199239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b62b92-e0c6-4c9b-9640-16210d6df1dc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.200053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b62b92-e0c6-4c9b-9640-16210d6df1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.236536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-23b62b92-e0c6-4c9b-9640-16210d6df1dc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:07.246169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-23b62b92-e0c6-4c9b-9640-16210d6df1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.337334 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1158/2317] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:07.339953 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b503e-4f7b-46a2-b6e7-c99cce451284 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.340408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b503e-4f7b-46a2-b6e7-c99cce451284 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.340869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b503e-4f7b-46a2-b6e7-c99cce451284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.375390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-8c7b503e-4f7b-46a2-b6e7-c99cce451284 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:07.377778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8c7b503e-4f7b-46a2-b6e7-c99cce451284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.398334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1160/2318] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:07.398708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b62b92-e0c6-4c9b-9640-16210d6df1dc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.412803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b62b92-e0c6-4c9b-9640-16210d6df1dc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.426555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562159b-aaf2-4f9e-befa-61375b15bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.431613 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562159b-aaf2-4f9e-befa-61375b15bc40 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.432181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562159b-aaf2-4f9e-befa-61375b15bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.432732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562159b-aaf2-4f9e-befa-61375b15bc40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.433326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562159b-aaf2-4f9e-befa-61375b15bc40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:07.433626 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562159b-aaf2-4f9e-befa-61375b15bc40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.436302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562159b-aaf2-4f9e-befa-61375b15bc40 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.451509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1159/2319] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:23:07.456441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b503e-4f7b-46a2-b6e7-c99cce451284 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.469556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b503e-4f7b-46a2-b6e7-c99cce451284 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.474531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532af4e-cd73-4eff-9c6c-2969fe800759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.475463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532af4e-cd73-4eff-9c6c-2969fe800759 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.475463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532af4e-cd73-4eff-9c6c-2969fe800759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.475715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532af4e-cd73-4eff-9c6c-2969fe800759 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.476291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532af4e-cd73-4eff-9c6c-2969fe800759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.478876 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532af4e-cd73-4eff-9c6c-2969fe800759 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.509138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1161/2320] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:07 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:07.513535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562159b-aaf2-4f9e-befa-61375b15bc40 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.525732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562159b-aaf2-4f9e-befa-61375b15bc40 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.573782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:07.608011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b5e0e-56ae-47b6-a797-b9a3a1f98e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.609084 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5e0e-56ae-47b6-a797-b9a3a1f98e0f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.609370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5e0e-56ae-47b6-a797-b9a3a1f98e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.609643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5e0e-56ae-47b6-a797-b9a3a1f98e0f admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.610361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b5e0e-56ae-47b6-a797-b9a3a1f98e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.612409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b5e0e-56ae-47b6-a797-b9a3a1f98e0f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.635495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1160/2321] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:07 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:07.640241 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532af4e-cd73-4eff-9c6c-2969fe800759 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.663882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532af4e-cd73-4eff-9c6c-2969fe800759 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.669308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da60ae2-69ba-4163-a08a-73733eb97ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.669955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da60ae2-69ba-4163-a08a-73733eb97ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.670235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da60ae2-69ba-4163-a08a-73733eb97ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.670506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da60ae2-69ba-4163-a08a-73733eb97ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.671151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da60ae2-69ba-4163-a08a-73733eb97ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.672823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da60ae2-69ba-4163-a08a-73733eb97ba8 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.684751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1162/2322] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:07.688599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b5e0e-56ae-47b6-a797-b9a3a1f98e0f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.698921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b5e0e-56ae-47b6-a797-b9a3a1f98e0f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.703777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa0ee8-f5c1-4548-82db-8102c9d881e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.704658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa0ee8-f5c1-4548-82db-8102c9d881e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.704969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa0ee8-f5c1-4548-82db-8102c9d881e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.705243 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa0ee8-f5c1-4548-82db-8102c9d881e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.705943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa0ee8-f5c1-4548-82db-8102c9d881e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.707593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa0ee8-f5c1-4548-82db-8102c9d881e7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.720261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1161/2323] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:07.724184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da60ae2-69ba-4163-a08a-73733eb97ba8 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.739383 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da60ae2-69ba-4163-a08a-73733eb97ba8 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.746209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c9e64-79c0-46d2-aa1f-c086eda5c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.746209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c9e64-79c0-46d2-aa1f-c086eda5c0a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.746209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c9e64-79c0-46d2-aa1f-c086eda5c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.746777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c9e64-79c0-46d2-aa1f-c086eda5c0a9 admin admin] PATH_INFO: `/v3/projects/2e30b70fb5684f64b5580e08a91aa43b/users/22b0f496ab2e49a19ae9b267ef624fb8/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.765662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c9e64-79c0-46d2-aa1f-c086eda5c0a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e30b70fb5684f64b5580e08a91aa43b, user_id=22b0f496ab2e49a19ae9b267ef624fb8, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.769209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c9e64-79c0-46d2-aa1f-c086eda5c0a9 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.787369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1163/2324] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:07 2022] PUT /identity/v3/projects/2e30b70fb5684f64b5580e08a91aa43b/users/22b0f496ab2e49a19ae9b267ef624fb8/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:07.798660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd8e4-8a87-4058-bcc8-6caab898afcd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.798942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd8e4-8a87-4058-bcc8-6caab898afcd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.799214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd8e4-8a87-4058-bcc8-6caab898afcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.848882 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-356dd8e4-8a87-4058-bcc8-6caab898afcd None None] MFA Rules not processed for user `22b0f496ab2e49a19ae9b267ef624fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:07.850143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-356dd8e4-8a87-4058-bcc8-6caab898afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.966589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1162/2325] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:07.993433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c9e64-79c0-46d2-aa1f-c086eda5c0a9 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.996075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4b8c9e64-79c0-46d2-aa1f-c086eda5c0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:08.090331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c9e64-79c0-46d2-aa1f-c086eda5c0a9 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:08.098263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84eac5-4853-43d2-90b4-8fb110a6ef47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:08.099134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84eac5-4853-43d2-90b4-8fb110a6ef47 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:08.099750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84eac5-4853-43d2-90b4-8fb110a6ef47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:08.100207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84eac5-4853-43d2-90b4-8fb110a6ef47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:08.112306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84eac5-4853-43d2-90b4-8fb110a6ef47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:08.114482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84eac5-4853-43d2-90b4-8fb110a6ef47 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:08.127007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1164/2326] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:09.757958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dd8e4-8a87-4058-bcc8-6caab898afcd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:09.759859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-356dd8e4-8a87-4058-bcc8-6caab898afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:09.801686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283f87-270a-43b6-88f2-97bca0455501 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:09.802211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283f87-270a-43b6-88f2-97bca0455501 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:09.802433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283f87-270a-43b6-88f2-97bca0455501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:09.842077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-36283f87-270a-43b6-88f2-97bca0455501 None None] MFA Rules not processed for user `22b0f496ab2e49a19ae9b267ef624fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:09.843963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-36283f87-270a-43b6-88f2-97bca0455501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:09.861256 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1165/2327] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:09.871230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dd8e4-8a87-4058-bcc8-6caab898afcd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:09.882605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:09.884038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:09.884430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:09.884844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] PATH_INFO: `/v3/users/8d152f781a2f479592e2db34a5a1bdd0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:09.886832 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d152f781a2f479592e2db34a5a1bdd0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:09.889361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:09.960647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:09.964270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d152f781a2f479592e2db34a5a1bdd0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.978484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d152f781a2f479592e2db34a5a1bdd0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.979576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d152f781a2f479592e2db34a5a1bdd0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.980317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d152f781a2f479592e2db34a5a1bdd0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.990452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d152f781a2f479592e2db34a5a1bdd0'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.025295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1163/2328] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:09 2022] DELETE /identity/v3/users/8d152f781a2f479592e2db34a5a1bdd0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:10.030121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0386-abfa-4897-9d9b-c5ebaf5f59d6 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:10.030472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0386-abfa-4897-9d9b-c5ebaf5f59d6 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:10.030879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0386-abfa-4897-9d9b-c5ebaf5f59d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:10.052549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-86da0386-abfa-4897-9d9b-c5ebaf5f59d6 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:10.054346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-86da0386-abfa-4897-9d9b-c5ebaf5f59d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:10.089184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:10.146066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1166/2329] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:10.157905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:10.160300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:10.245850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f7c72-e65f-4d76-8af8-723beb5e3e07 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:10.249833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e8bb3-0646-4af9-84ba-57bf0f8498b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:10.250445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e8bb3-0646-4af9-84ba-57bf0f8498b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:10.250890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e8bb3-0646-4af9-84ba-57bf0f8498b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:10.251298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e8bb3-0646-4af9-84ba-57bf0f8498b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:10.262068 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e8bb3-0646-4af9-84ba-57bf0f8498b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:10.263570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e8bb3-0646-4af9-84ba-57bf0f8498b8 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:10.283828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1164/2330] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:23:10.745107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da0386-abfa-4897-9d9b-c5ebaf5f59d6 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:10.746691 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-86da0386-abfa-4897-9d9b-c5ebaf5f59d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:10.764885 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da0386-abfa-4897-9d9b-c5ebaf5f59d6 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:10.770012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:10.770654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:10.770931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:10.771257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] PATH_INFO: `/v3/projects/d6426a79ce2d460595de7e656936224f` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:10.772797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6426a79ce2d460595de7e656936224f)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:10.775552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:10.830742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6426a79ce2d460595de7e656936224f', 'request_id': 'req-07ce951f-965c-4c7f-877b-4e3662847140'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.837839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6426a79ce2d460595de7e656936224f', 'request_id': 'req-07ce951f-965c-4c7f-877b-4e3662847140'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.846937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6426a79ce2d460595de7e656936224f', 'request_id': 'req-07ce951f-965c-4c7f-877b-4e3662847140'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.860762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] The token cache is being invalidate because project d6426a79ce2d460595de7e656936224f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:10.861145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.861946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07ce951f-965c-4c7f-877b-4e3662847140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.864016 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1167/2331] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:10 2022] DELETE /identity/v3/projects/d6426a79ce2d460595de7e656936224f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:10.869512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc2524-2fba-4879-b484-b2ed248a2417 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:10.870036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc2524-2fba-4879-b484-b2ed248a2417 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:10.870036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc2524-2fba-4879-b484-b2ed248a2417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:10.896798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-65bc2524-2fba-4879-b484-b2ed248a2417 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:10.898295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-65bc2524-2fba-4879-b484-b2ed248a2417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:10.974446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1165/2332] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:10.984053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253a1de-d0a2-4bea-a184-00e75de09275 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:10.984669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253a1de-d0a2-4bea-a184-00e75de09275 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:10.985118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253a1de-d0a2-4bea-a184-00e75de09275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.015632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5253a1de-d0a2-4bea-a184-00e75de09275 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:11.016878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5253a1de-d0a2-4bea-a184-00e75de09275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:11.029508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1168/2333] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:11.030191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc2524-2fba-4879-b484-b2ed248a2417 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.042205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc2524-2fba-4879-b484-b2ed248a2417 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.046676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea2544-d2ab-4072-975c-f3a8c1492d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.047442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2544-d2ab-4072-975c-f3a8c1492d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.047683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2544-d2ab-4072-975c-f3a8c1492d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.048036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea2544-d2ab-4072-975c-f3a8c1492d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.048845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea2544-d2ab-4072-975c-f3a8c1492d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:11.049339 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea2544-d2ab-4072-975c-f3a8c1492d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.052072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea2544-d2ab-4072-975c-f3a8c1492d34 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.069745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1166/2334] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:23:11.074760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253a1de-d0a2-4bea-a184-00e75de09275 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.084375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253a1de-d0a2-4bea-a184-00e75de09275 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.091944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4d45d-2379-41ff-a46f-544fbca90533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.092444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d45d-2379-41ff-a46f-544fbca90533 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.092777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d45d-2379-41ff-a46f-544fbca90533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.093053 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d45d-2379-41ff-a46f-544fbca90533 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.093687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4d45d-2379-41ff-a46f-544fbca90533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.095710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4d45d-2379-41ff-a46f-544fbca90533 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.123578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1169/2335] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:11 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:11.127704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea2544-d2ab-4072-975c-f3a8c1492d34 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.138770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea2544-d2ab-4072-975c-f3a8c1492d34 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.193785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:11.206911 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbe585-76c6-45eb-9573-2fbc2c794c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.207528 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbe585-76c6-45eb-9573-2fbc2c794c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.207814 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbe585-76c6-45eb-9573-2fbc2c794c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.208086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbe585-76c6-45eb-9573-2fbc2c794c4c admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.208739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbe585-76c6-45eb-9573-2fbc2c794c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.210701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbe585-76c6-45eb-9573-2fbc2c794c4c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.233281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1167/2336] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:11 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:11.245763 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4d45d-2379-41ff-a46f-544fbca90533 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.256272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4d45d-2379-41ff-a46f-544fbca90533 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.262488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2353d-cd7b-4f26-aeb5-dd251a4496b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.263088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2353d-cd7b-4f26-aeb5-dd251a4496b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.263365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2353d-cd7b-4f26-aeb5-dd251a4496b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.263633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2353d-cd7b-4f26-aeb5-dd251a4496b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.264265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2353d-cd7b-4f26-aeb5-dd251a4496b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.265890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2353d-cd7b-4f26-aeb5-dd251a4496b8 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.277232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1170/2337] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:11.281040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbe585-76c6-45eb-9573-2fbc2c794c4c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.291205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbe585-76c6-45eb-9573-2fbc2c794c4c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.295804 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385cd99-50a8-4bfc-8933-eaf6cba541ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.296391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385cd99-50a8-4bfc-8933-eaf6cba541ce admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.296701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385cd99-50a8-4bfc-8933-eaf6cba541ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.296970 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385cd99-50a8-4bfc-8933-eaf6cba541ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.297616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385cd99-50a8-4bfc-8933-eaf6cba541ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.299212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385cd99-50a8-4bfc-8933-eaf6cba541ce admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.311372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1168/2338] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:11.315325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2353d-cd7b-4f26-aeb5-dd251a4496b8 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.325871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2353d-cd7b-4f26-aeb5-dd251a4496b8 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.330424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e85e1-d43d-468d-be03-8f7ccebb08c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.331060 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e85e1-d43d-468d-be03-8f7ccebb08c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.331336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e85e1-d43d-468d-be03-8f7ccebb08c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.331604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e85e1-d43d-468d-be03-8f7ccebb08c1 admin admin] PATH_INFO: `/v3/projects/d424a6158b7546599124e1c8b9bbc7ba/users/833aca3085cf42858058177def3b7d9b/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.345975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e85e1-d43d-468d-be03-8f7ccebb08c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d424a6158b7546599124e1c8b9bbc7ba, user_id=833aca3085cf42858058177def3b7d9b, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.348598 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e85e1-d43d-468d-be03-8f7ccebb08c1 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.361454 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1171/2339] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:11 2022] PUT /identity/v3/projects/d424a6158b7546599124e1c8b9bbc7ba/users/833aca3085cf42858058177def3b7d9b/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:11.372991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354635d-3106-405d-895d-c778767d5ec0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.373269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354635d-3106-405d-895d-c778767d5ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.373537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354635d-3106-405d-895d-c778767d5ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.400660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d354635d-3106-405d-895d-c778767d5ec0 None None] MFA Rules not processed for user `833aca3085cf42858058177def3b7d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:11.401898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d354635d-3106-405d-895d-c778767d5ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:11.466161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1169/2340] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:11.477577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e85e1-d43d-468d-be03-8f7ccebb08c1 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.479329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d67e85e1-d43d-468d-be03-8f7ccebb08c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:11.532708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:11.538628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e85e1-d43d-468d-be03-8f7ccebb08c1 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.543032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479960d-067b-4bad-a725-02c98618d05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.543632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479960d-067b-4bad-a725-02c98618d05c service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.543906 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479960d-067b-4bad-a725-02c98618d05c service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.544173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479960d-067b-4bad-a725-02c98618d05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.552845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479960d-067b-4bad-a725-02c98618d05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.554288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479960d-067b-4bad-a725-02c98618d05c service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.563696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1172/2341] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:11 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:15.317376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3e610-7ab8-4f04-bcad-e9e9da4d0f2d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:15.318458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3e610-7ab8-4f04-bcad-e9e9da4d0f2d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:15.318879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3e610-7ab8-4f04-bcad-e9e9da4d0f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:15.343434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4bc3e610-7ab8-4f04-bcad-e9e9da4d0f2d None None] MFA Rules not processed for user `fcedc1966e19490fb739046a3379b135`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:15.345138 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4bc3e610-7ab8-4f04-bcad-e9e9da4d0f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:15.424676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1170/2342] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:15.997888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479960d-067b-4bad-a725-02c98618d05c service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:16.067216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479960d-067b-4bad-a725-02c98618d05c service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:16.072757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:16.073456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:16.073659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:16.074350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] PATH_INFO: `/v3/users/833aca3085cf42858058177def3b7d9b` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:16.075458 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=833aca3085cf42858058177def3b7d9b)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:16.077463 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:16.155380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833aca3085cf42858058177def3b7d9b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:16.163494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833aca3085cf42858058177def3b7d9b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:16.164275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833aca3085cf42858058177def3b7d9b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:16.165061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833aca3085cf42858058177def3b7d9b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:16.184335 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833aca3085cf42858058177def3b7d9b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:16.217632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1173/2343] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:15 2022] DELETE /identity/v3/users/833aca3085cf42858058177def3b7d9b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:16.221880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ff47-5378-461c-a98f-fb0ecfd6f8e1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:16.222275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ff47-5378-461c-a98f-fb0ecfd6f8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:16.222619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ff47-5378-461c-a98f-fb0ecfd6f8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:16.244278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-71d6ff47-5378-461c-a98f-fb0ecfd6f8e1 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:16.245631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-71d6ff47-5378-461c-a98f-fb0ecfd6f8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:16.331713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1171/2344] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:16.343240 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:16.345080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:16.453753 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948ce35-0fb7-4a34-a144-738ae3035c87 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:16.464799 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcc600-a2f3-4df4-85e2-837d36d9d4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:16.465440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcc600-a2f3-4df4-85e2-837d36d9d4db service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:16.465821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcc600-a2f3-4df4-85e2-837d36d9d4db service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:16.466477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcc600-a2f3-4df4-85e2-837d36d9d4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:16.479185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcc600-a2f3-4df4-85e2-837d36d9d4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:16.480766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcc600-a2f3-4df4-85e2-837d36d9d4db service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:16.495514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1174/2345] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:23:17.038021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ff47-5378-461c-a98f-fb0ecfd6f8e1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:17.040287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-71d6ff47-5378-461c-a98f-fb0ecfd6f8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:17.055524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:17.062221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ff47-5378-461c-a98f-fb0ecfd6f8e1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:17.067905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:17.068709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.069246 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.069615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] PATH_INFO: `/v3/projects/d424a6158b7546599124e1c8b9bbc7ba` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.071419 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d424a6158b7546599124e1c8b9bbc7ba)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:17.073466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:17.131291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd424a6158b7546599124e1c8b9bbc7ba', 'request_id': 'req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:17.140576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd424a6158b7546599124e1c8b9bbc7ba', 'request_id': 'req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:17.151534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd424a6158b7546599124e1c8b9bbc7ba', 'request_id': 'req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:17.172091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] The token cache is being invalidate because project d424a6158b7546599124e1c8b9bbc7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:17.172422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:17.176836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-ef3ce2b2-5039-4dc9-9e40-5680f681b6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:17.178825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1172/2346] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:17 2022] DELETE /identity/v3/projects/d424a6158b7546599124e1c8b9bbc7ba => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:17.183416 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172b1c-21f2-4d3d-a3af-8eceac585c7d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.183913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172b1c-21f2-4d3d-a3af-8eceac585c7d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.184093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172b1c-21f2-4d3d-a3af-8eceac585c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.204238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-1d172b1c-21f2-4d3d-a3af-8eceac585c7d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:17.205790 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1d172b1c-21f2-4d3d-a3af-8eceac585c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:17.213125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:17.287013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1175/2347] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:17.295172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522bca-b929-442d-ad00-765d35052d0d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.295577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522bca-b929-442d-ad00-765d35052d0d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.295917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522bca-b929-442d-ad00-765d35052d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.321654 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-91522bca-b929-442d-ad00-765d35052d0d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:17.324356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-91522bca-b929-442d-ad00-765d35052d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:17.333751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1173/2348] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:17.338314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d172b1c-21f2-4d3d-a3af-8eceac585c7d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:17.348208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d172b1c-21f2-4d3d-a3af-8eceac585c7d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:17.353259 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc196-7168-451b-941d-22890e34ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:17.353881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc196-7168-451b-941d-22890e34ef71 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.354156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc196-7168-451b-941d-22890e34ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.354419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc196-7168-451b-941d-22890e34ef71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.355045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dc196-7168-451b-941d-22890e34ef71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:17.355342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dc196-7168-451b-941d-22890e34ef71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:17.356960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dc196-7168-451b-941d-22890e34ef71 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:17.369607 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1176/2349] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:23:17.373523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91522bca-b929-442d-ad00-765d35052d0d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:17.384003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91522bca-b929-442d-ad00-765d35052d0d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:17.388695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10263a-6d37-4d79-881d-f39072282cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:17.389290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10263a-6d37-4d79-881d-f39072282cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.389569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10263a-6d37-4d79-881d-f39072282cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.389840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10263a-6d37-4d79-881d-f39072282cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.390460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10263a-6d37-4d79-881d-f39072282cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:17.392402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10263a-6d37-4d79-881d-f39072282cfb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:17.420326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1174/2350] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:17 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:23:17.423903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc196-7168-451b-941d-22890e34ef71 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:17.435075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc196-7168-451b-941d-22890e34ef71 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:17.491293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa828b8a-1dce-4351-9ff2-46d0dc367a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:17.491814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa828b8a-1dce-4351-9ff2-46d0dc367a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.492092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa828b8a-1dce-4351-9ff2-46d0dc367a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.492949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa828b8a-1dce-4351-9ff2-46d0dc367a4e admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.493542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa828b8a-1dce-4351-9ff2-46d0dc367a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:17.495468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa828b8a-1dce-4351-9ff2-46d0dc367a4e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:17.516848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1177/2351] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:17 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:17.520976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10263a-6d37-4d79-881d-f39072282cfb admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:17.532378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10263a-6d37-4d79-881d-f39072282cfb admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:17.539077 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f195e8-2c41-4d62-ba9a-e73830206d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:17.540372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f195e8-2c41-4d62-ba9a-e73830206d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.540907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f195e8-2c41-4d62-ba9a-e73830206d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.541293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f195e8-2c41-4d62-ba9a-e73830206d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.542076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f195e8-2c41-4d62-ba9a-e73830206d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:17.544917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f195e8-2c41-4d62-ba9a-e73830206d30 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:17.558190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1175/2352] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:17.562723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa828b8a-1dce-4351-9ff2-46d0dc367a4e admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:17.581435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa828b8a-1dce-4351-9ff2-46d0dc367a4e admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:17.601597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e460ab-8348-4e26-b825-1f8bdccc6fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:17.602375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e460ab-8348-4e26-b825-1f8bdccc6fea admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.602883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e460ab-8348-4e26-b825-1f8bdccc6fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.603223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e460ab-8348-4e26-b825-1f8bdccc6fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.604108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e460ab-8348-4e26-b825-1f8bdccc6fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:17.606916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e460ab-8348-4e26-b825-1f8bdccc6fea admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:17.622464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1178/2353] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:17.626248 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f195e8-2c41-4d62-ba9a-e73830206d30 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:17.639910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f195e8-2c41-4d62-ba9a-e73830206d30 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:17.652967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f59cb-0d8e-4d6b-9bfc-a3abcbf025a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:17.652967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f59cb-0d8e-4d6b-9bfc-a3abcbf025a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.652967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f59cb-0d8e-4d6b-9bfc-a3abcbf025a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.652967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f59cb-0d8e-4d6b-9bfc-a3abcbf025a1 admin admin] PATH_INFO: `/v3/projects/fd5a1ee88149444db094adf93e8c1ad6/users/a14a743ee4924fc5855c0278df7ca5e8/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.680454 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f59cb-0d8e-4d6b-9bfc-a3abcbf025a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5a1ee88149444db094adf93e8c1ad6, user_id=a14a743ee4924fc5855c0278df7ca5e8, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:17.685041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f59cb-0d8e-4d6b-9bfc-a3abcbf025a1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:17.708231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1176/2354] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:17 2022] PUT /identity/v3/projects/fd5a1ee88149444db094adf93e8c1ad6/users/a14a743ee4924fc5855c0278df7ca5e8/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:17.709938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f499-fc0c-4857-9dfc-add0ad81f199 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.710394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f499-fc0c-4857-9dfc-add0ad81f199 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.710739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f499-fc0c-4857-9dfc-add0ad81f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.733157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-1de8f499-fc0c-4857-9dfc-add0ad81f199 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:17.734478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1de8f499-fc0c-4857-9dfc-add0ad81f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:17.823353 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1179/2355] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:17.832839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f59cb-0d8e-4d6b-9bfc-a3abcbf025a1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:17.834637 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-814f59cb-0d8e-4d6b-9bfc-a3abcbf025a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:17.893509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f59cb-0d8e-4d6b-9bfc-a3abcbf025a1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:17.897174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106470f-2f9b-4384-8e5e-508611970d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:17.897778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106470f-2f9b-4384-8e5e-508611970d5f service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:17.898052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106470f-2f9b-4384-8e5e-508611970d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:17.898319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106470f-2f9b-4384-8e5e-508611970d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:17.907382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106470f-2f9b-4384-8e5e-508611970d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:17.908852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106470f-2f9b-4384-8e5e-508611970d5f service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:17.919024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1177/2356] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:20.568725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8f499-fc0c-4857-9dfc-add0ad81f199 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:20.573261 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1de8f499-fc0c-4857-9dfc-add0ad81f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:20.614951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8f499-fc0c-4857-9dfc-add0ad81f199 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:20.624544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:20.624990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:20.625272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:20.625542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] PATH_INFO: `/v3/users/434797676ed34891873ebe95361805a0` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:20.630476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=434797676ed34891873ebe95361805a0)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:20.632421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:20.670843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:20.729411 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434797676ed34891873ebe95361805a0'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:20.745500 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434797676ed34891873ebe95361805a0'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:20.746406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434797676ed34891873ebe95361805a0'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:20.747716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434797676ed34891873ebe95361805a0'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:20.764999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434797676ed34891873ebe95361805a0'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:20.796827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1180/2357] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:20 2022] DELETE /identity/v3/users/434797676ed34891873ebe95361805a0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:20.797682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a1d38-2663-4140-b442-5cd9e4d79b47 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:20.798815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a1d38-2663-4140-b442-5cd9e4d79b47 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:20.798815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a1d38-2663-4140-b442-5cd9e4d79b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:20.825391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-386a1d38-2663-4140-b442-5cd9e4d79b47 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:20.826739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-386a1d38-2663-4140-b442-5cd9e4d79b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:20.855877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:20.923484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1178/2358] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:20.950428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:20.952543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:21.029290 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcd7b3-66e4-46e3-9916-ea588022eacd admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:21.035037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73aea52-eb08-4dd6-bef0-9dc92da2972b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:21.036261 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73aea52-eb08-4dd6-bef0-9dc92da2972b service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:21.036979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73aea52-eb08-4dd6-bef0-9dc92da2972b service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:21.037418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73aea52-eb08-4dd6-bef0-9dc92da2972b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:21.057025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73aea52-eb08-4dd6-bef0-9dc92da2972b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:21.059097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73aea52-eb08-4dd6-bef0-9dc92da2972b service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:21.078918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1181/2359] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:23:21.750922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a1d38-2663-4140-b442-5cd9e4d79b47 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:21.752374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-386a1d38-2663-4140-b442-5cd9e4d79b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:21.764538 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a1d38-2663-4140-b442-5cd9e4d79b47 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:21.770185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:21.770862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:21.773250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:21.773250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] PATH_INFO: `/v3/projects/671ad8384c3d4476a349b23155d5f3df` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:21.775852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671ad8384c3d4476a349b23155d5f3df)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:21.777869 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:21.854798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671ad8384c3d4476a349b23155d5f3df', 'request_id': 'req-f8d9e637-bebd-4345-b8ae-df665f44b625'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:21.863126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671ad8384c3d4476a349b23155d5f3df', 'request_id': 'req-f8d9e637-bebd-4345-b8ae-df665f44b625'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:21.878033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671ad8384c3d4476a349b23155d5f3df', 'request_id': 'req-f8d9e637-bebd-4345-b8ae-df665f44b625'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:21.903946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] The token cache is being invalidate because project 671ad8384c3d4476a349b23155d5f3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:21.904551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:21.905566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f8d9e637-bebd-4345-b8ae-df665f44b625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:21.908342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1179/2360] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:21 2022] DELETE /identity/v3/projects/671ad8384c3d4476a349b23155d5f3df => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:21.915515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f34b4-178c-4c69-8566-6c9b23aeb149 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:21.916932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f34b4-178c-4c69-8566-6c9b23aeb149 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:21.917381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f34b4-178c-4c69-8566-6c9b23aeb149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:21.952768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c01f34b4-178c-4c69-8566-6c9b23aeb149 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:21.954804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c01f34b4-178c-4c69-8566-6c9b23aeb149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:22.046137 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1182/2361] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:22.055188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7d8d-4cc2-4abd-a582-6aaea149004e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:22.055752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7d8d-4cc2-4abd-a582-6aaea149004e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:22.056313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7d8d-4cc2-4abd-a582-6aaea149004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:22.077148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fbee7d8d-4cc2-4abd-a582-6aaea149004e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:22.078613 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fbee7d8d-4cc2-4abd-a582-6aaea149004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:22.092067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1180/2362] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:22.096343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f34b4-178c-4c69-8566-6c9b23aeb149 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:22.107678 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f34b4-178c-4c69-8566-6c9b23aeb149 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:22.112186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b564478-dcc0-4311-85cb-2ed675261a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:22.112816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b564478-dcc0-4311-85cb-2ed675261a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:22.113092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b564478-dcc0-4311-85cb-2ed675261a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:22.113358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b564478-dcc0-4311-85cb-2ed675261a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:22.114174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b564478-dcc0-4311-85cb-2ed675261a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:22.114624 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b564478-dcc0-4311-85cb-2ed675261a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:22.117667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b564478-dcc0-4311-85cb-2ed675261a11 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:22.132320 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1183/2363] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:23:22.136992 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7d8d-4cc2-4abd-a582-6aaea149004e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:22.153293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7d8d-4cc2-4abd-a582-6aaea149004e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:22.159229 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354841dd-b49d-4a1f-87a7-ccd9e45ef766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:22.160067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354841dd-b49d-4a1f-87a7-ccd9e45ef766 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:22.160616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354841dd-b49d-4a1f-87a7-ccd9e45ef766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:22.161323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354841dd-b49d-4a1f-87a7-ccd9e45ef766 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:22.162190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354841dd-b49d-4a1f-87a7-ccd9e45ef766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:22.164789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354841dd-b49d-4a1f-87a7-ccd9e45ef766 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:22.213197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1181/2364] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:22 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:22.218904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b564478-dcc0-4311-85cb-2ed675261a11 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:22.231100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b564478-dcc0-4311-85cb-2ed675261a11 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:22.263676 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:22.354555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bcaec-62de-4e2e-aefd-07ef3653fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:22.356226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bcaec-62de-4e2e-aefd-07ef3653fcfe admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:22.356726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bcaec-62de-4e2e-aefd-07ef3653fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:22.358009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bcaec-62de-4e2e-aefd-07ef3653fcfe admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:22.359469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bcaec-62de-4e2e-aefd-07ef3653fcfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:22.362341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bcaec-62de-4e2e-aefd-07ef3653fcfe admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:22.395901 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1184/2365] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:22 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:22.401244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354841dd-b49d-4a1f-87a7-ccd9e45ef766 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:22.416069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354841dd-b49d-4a1f-87a7-ccd9e45ef766 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:22.421373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16a5e7-4a43-48ed-bf5d-89a8b4cc7b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:22.422292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16a5e7-4a43-48ed-bf5d-89a8b4cc7b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:22.422748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16a5e7-4a43-48ed-bf5d-89a8b4cc7b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:22.423194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16a5e7-4a43-48ed-bf5d-89a8b4cc7b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:22.423991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16a5e7-4a43-48ed-bf5d-89a8b4cc7b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:22.426434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16a5e7-4a43-48ed-bf5d-89a8b4cc7b76 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:22.437859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1182/2366] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:22.442301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bcaec-62de-4e2e-aefd-07ef3653fcfe admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:22.453733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bcaec-62de-4e2e-aefd-07ef3653fcfe admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:22.459354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9b106-4dcc-4802-9138-d54b86f1da2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:22.460092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9b106-4dcc-4802-9138-d54b86f1da2f admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:22.460377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9b106-4dcc-4802-9138-d54b86f1da2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:22.460830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9b106-4dcc-4802-9138-d54b86f1da2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:22.462211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9b106-4dcc-4802-9138-d54b86f1da2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:22.464233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9b106-4dcc-4802-9138-d54b86f1da2f admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:22.479054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1185/2367] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:22.483634 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16a5e7-4a43-48ed-bf5d-89a8b4cc7b76 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:22.494786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16a5e7-4a43-48ed-bf5d-89a8b4cc7b76 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:22.501527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0760-a25a-47c8-af05-851e1ffde95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:22.502574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0760-a25a-47c8-af05-851e1ffde95a admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:22.502909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0760-a25a-47c8-af05-851e1ffde95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:22.503188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0760-a25a-47c8-af05-851e1ffde95a admin admin] PATH_INFO: `/v3/projects/57b7b909e765432bb4cc7c7c6c404970/users/c81131f210d44cfea4d6e7a34ad8cef2/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:22.540455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db0760-a25a-47c8-af05-851e1ffde95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b7b909e765432bb4cc7c7c6c404970, user_id=c81131f210d44cfea4d6e7a34ad8cef2, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:22.543172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db0760-a25a-47c8-af05-851e1ffde95a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:22.582141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1183/2368] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:22 2022] PUT /identity/v3/projects/57b7b909e765432bb4cc7c7c6c404970/users/c81131f210d44cfea4d6e7a34ad8cef2/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:22.583440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafeb40-370e-4e51-a21a-dabd09c368f2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:22.583801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafeb40-370e-4e51-a21a-dabd09c368f2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:22.584143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafeb40-370e-4e51-a21a-dabd09c368f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:22.649475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-0dafeb40-370e-4e51-a21a-dabd09c368f2 None None] MFA Rules not processed for user `c81131f210d44cfea4d6e7a34ad8cef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:22.651057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-0dafeb40-370e-4e51-a21a-dabd09c368f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:22.735057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1186/2369] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:22.746909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0760-a25a-47c8-af05-851e1ffde95a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:22.748846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-63db0760-a25a-47c8-af05-851e1ffde95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:22.833190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:22.844644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0760-a25a-47c8-af05-851e1ffde95a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:22.855522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e639ef4-4a20-4b36-8939-4b227958c83c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:22.855522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639ef4-4a20-4b36-8939-4b227958c83c service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:22.855522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639ef4-4a20-4b36-8939-4b227958c83c service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:22.855522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639ef4-4a20-4b36-8939-4b227958c83c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:22.871103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e639ef4-4a20-4b36-8939-4b227958c83c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:22.872667 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e639ef4-4a20-4b36-8939-4b227958c83c service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:22.885713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1184/2370] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:23:22.915626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafeb40-370e-4e51-a21a-dabd09c368f2 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:22.989593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafeb40-370e-4e51-a21a-dabd09c368f2 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:22.996384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:22.997063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:22.997337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:22.997602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] PATH_INFO: `/v3/users/c81131f210d44cfea4d6e7a34ad8cef2` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:22.998767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81131f210d44cfea4d6e7a34ad8cef2)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:23.000745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:23.061145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:23.083789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81131f210d44cfea4d6e7a34ad8cef2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:23.097609 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81131f210d44cfea4d6e7a34ad8cef2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:23.098302 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81131f210d44cfea4d6e7a34ad8cef2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:23.099273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81131f210d44cfea4d6e7a34ad8cef2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:23.108740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81131f210d44cfea4d6e7a34ad8cef2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:23.129300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1187/2371] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:22 2022] DELETE /identity/v3/users/c81131f210d44cfea4d6e7a34ad8cef2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:23.135149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7e34e-380f-48c1-b757-7001a06c74a3 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:23.135438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7e34e-380f-48c1-b757-7001a06c74a3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:23.135712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7e34e-380f-48c1-b757-7001a06c74a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:23.156712 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-c2e7e34e-380f-48c1-b757-7001a06c74a3 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:23.157964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c2e7e34e-380f-48c1-b757-7001a06c74a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:23.239851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1185/2372] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:23.251260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:23.252975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:23.369274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2d8a7-b3df-4c23-933a-3e575757473b admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:23.376050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fb269-e9e3-4822-9aff-941e4041597d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:23.380964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb269-e9e3-4822-9aff-941e4041597d service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:23.381884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb269-e9e3-4822-9aff-941e4041597d service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:23.382180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb269-e9e3-4822-9aff-941e4041597d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:23.401914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fb269-e9e3-4822-9aff-941e4041597d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:23.405608 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fb269-e9e3-4822-9aff-941e4041597d service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:23.428347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1188/2373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:23.806910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7e34e-380f-48c1-b757-7001a06c74a3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:23.808465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c2e7e34e-380f-48c1-b757-7001a06c74a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:23.822431 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7e34e-380f-48c1-b757-7001a06c74a3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:23.827931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:23.829031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:23.829559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:23.830061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] PATH_INFO: `/v3/projects/57b7b909e765432bb4cc7c7c6c404970` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:23.831842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b7b909e765432bb4cc7c7c6c404970)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:23.834637 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:23.911948 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b7b909e765432bb4cc7c7c6c404970', 'request_id': 'req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:23.919439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b7b909e765432bb4cc7c7c6c404970', 'request_id': 'req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:23.928029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b7b909e765432bb4cc7c7c6c404970', 'request_id': 'req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:23.943545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] The token cache is being invalidate because project 57b7b909e765432bb4cc7c7c6c404970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:23.944394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:23.945710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:23.947497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1186/2374] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:23 2022] DELETE /identity/v3/projects/57b7b909e765432bb4cc7c7c6c404970 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:24.601718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41519985-fe4e-4e56-bbe8-f0269e36a42a None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:24.602248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41519985-fe4e-4e56-bbe8-f0269e36a42a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:24.602248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41519985-fe4e-4e56-bbe8-f0269e36a42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:24.635555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-41519985-fe4e-4e56-bbe8-f0269e36a42a None None] MFA Rules not processed for user `a14a743ee4924fc5855c0278df7ca5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:24.636868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-41519985-fe4e-4e56-bbe8-f0269e36a42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:24.715584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1189/2375] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:24.720864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:24.722596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:24.810607 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92672b1-f5ed-4ad6-89de-4f5cba4b20a5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:24.816518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b5625-ffbc-4d00-b038-4f07357f3c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:24.817278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b5625-ffbc-4d00-b038-4f07357f3c82 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:24.817638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b5625-ffbc-4d00-b038-4f07357f3c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:24.818593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b5625-ffbc-4d00-b038-4f07357f3c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:24.818593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b5625-ffbc-4d00-b038-4f07357f3c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:24.821357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b5625-ffbc-4d00-b038-4f07357f3c82 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:24.845399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:24.859045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1187/2376] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:24 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:24.860323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41519985-fe4e-4e56-bbe8-f0269e36a42a None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:24.875557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41519985-fe4e-4e56-bbe8-f0269e36a42a None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:24.921494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:24.947611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84557685-4546-425e-84d6-fec371dcafbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:24.948216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84557685-4546-425e-84d6-fec371dcafbd admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:24.948494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84557685-4546-425e-84d6-fec371dcafbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:24.948803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84557685-4546-425e-84d6-fec371dcafbd admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:24.949432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84557685-4546-425e-84d6-fec371dcafbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:24.951365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84557685-4546-425e-84d6-fec371dcafbd admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:24.975504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1190/2377] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:24 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:24.980476 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b5625-ffbc-4d00-b038-4f07357f3c82 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:24.991387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b5625-ffbc-4d00-b038-4f07357f3c82 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:24.996724 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c07b8-ca02-4e87-a063-95ea2d9a7c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:24.997340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c07b8-ca02-4e87-a063-95ea2d9a7c31 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:24.997618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c07b8-ca02-4e87-a063-95ea2d9a7c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:24.997883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c07b8-ca02-4e87-a063-95ea2d9a7c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:24.998521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c07b8-ca02-4e87-a063-95ea2d9a7c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:25.000175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c07b8-ca02-4e87-a063-95ea2d9a7c31 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:25.015388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1188/2378] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:25.019773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84557685-4546-425e-84d6-fec371dcafbd admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:25.031989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84557685-4546-425e-84d6-fec371dcafbd admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:25.042623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c965e9-51cb-43e2-b052-35604ef2738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:25.043473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c965e9-51cb-43e2-b052-35604ef2738c admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.043834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c965e9-51cb-43e2-b052-35604ef2738c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.044186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c965e9-51cb-43e2-b052-35604ef2738c admin admin] PATH_INFO: `/v3/projects/75a98f5cebc34159a26b022ff7a68960/users/04243556b5c0420187228f085d847cef/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.081192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c965e9-51cb-43e2-b052-35604ef2738c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a98f5cebc34159a26b022ff7a68960, user_id=04243556b5c0420187228f085d847cef, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:25.084395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c965e9-51cb-43e2-b052-35604ef2738c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:25.110067 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1191/2379] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:25 2022] PUT /identity/v3/projects/75a98f5cebc34159a26b022ff7a68960/users/04243556b5c0420187228f085d847cef/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:25.114079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c07b8-ca02-4e87-a063-95ea2d9a7c31 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:25.136821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c07b8-ca02-4e87-a063-95ea2d9a7c31 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:25.259041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a7a61-06c5-4eaa-a9b0-beafc8880977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:25.260323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a7a61-06c5-4eaa-a9b0-beafc8880977 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.260581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a7a61-06c5-4eaa-a9b0-beafc8880977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.260988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a7a61-06c5-4eaa-a9b0-beafc8880977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.261995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a7a61-06c5-4eaa-a9b0-beafc8880977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:25.264587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a7a61-06c5-4eaa-a9b0-beafc8880977 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:25.280675 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1189/2380] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:25.283066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c965e9-51cb-43e2-b052-35604ef2738c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:25.295230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c965e9-51cb-43e2-b052-35604ef2738c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:25.300336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f19998-1e3d-40a3-b503-6a0b79560688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:25.301348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f19998-1e3d-40a3-b503-6a0b79560688 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.301582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f19998-1e3d-40a3-b503-6a0b79560688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.301850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f19998-1e3d-40a3-b503-6a0b79560688 admin admin] PATH_INFO: `/v3/projects/75a98f5cebc34159a26b022ff7a68960/users/04243556b5c0420187228f085d847cef/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.303839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f19998-1e3d-40a3-b503-6a0b79560688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a98f5cebc34159a26b022ff7a68960, user_id=04243556b5c0420187228f085d847cef, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:25.306812 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f19998-1e3d-40a3-b503-6a0b79560688 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:25.322263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1192/2381] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:25 2022] PUT /identity/v3/projects/75a98f5cebc34159a26b022ff7a68960/users/04243556b5c0420187228f085d847cef/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:30.644058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71a829-00c7-45ce-be60-92c18d44a71a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:30.644513 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71a829-00c7-45ce-be60-92c18d44a71a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:30.644608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71a829-00c7-45ce-be60-92c18d44a71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:30.684587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6a71a829-00c7-45ce-be60-92c18d44a71a None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:30.686207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6a71a829-00c7-45ce-be60-92c18d44a71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:30.798224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1190/2382] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:23:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:30.857099 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f19998-1e3d-40a3-b503-6a0b79560688 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:30.860504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-94f19998-1e3d-40a3-b503-6a0b79560688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:30.970305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f19998-1e3d-40a3-b503-6a0b79560688 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:30.981503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39202dd-be86-46aa-9264-bf75e6cfc79a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:30.982244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39202dd-be86-46aa-9264-bf75e6cfc79a service swift] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:30.982728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39202dd-be86-46aa-9264-bf75e6cfc79a service swift] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:30.982843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39202dd-be86-46aa-9264-bf75e6cfc79a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:30.995849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39202dd-be86-46aa-9264-bf75e6cfc79a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:30.998513 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39202dd-be86-46aa-9264-bf75e6cfc79a service swift] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:31.013597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1193/2383] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:23:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:23:31.845140 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ee88b-9751-4400-a78d-30f9f6710e0a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:31.846091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ee88b-9751-4400-a78d-30f9f6710e0a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:31.846600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ee88b-9751-4400-a78d-30f9f6710e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:31.887357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0c5ee88b-9751-4400-a78d-30f9f6710e0a None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:31.889293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0c5ee88b-9751-4400-a78d-30f9f6710e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:31.897629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1191/2384] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 9 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:31.920944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39202dd-be86-46aa-9264-bf75e6cfc79a service swift] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:31.936759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39202dd-be86-46aa-9264-bf75e6cfc79a service swift] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:31.943040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dfccb-cb53-4796-ad77-0053b5d206a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:31.943618 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dfccb-cb53-4796-ad77-0053b5d206a1 service swift] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:31.943985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dfccb-cb53-4796-ad77-0053b5d206a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:31.944150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dfccb-cb53-4796-ad77-0053b5d206a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:31.955195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dfccb-cb53-4796-ad77-0053b5d206a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:31.957191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dfccb-cb53-4796-ad77-0053b5d206a1 service swift] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:31.970789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1194/2385] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:23:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:23:32.286214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994376d9-7273-4704-96f4-068a06b94f28 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:32.286595 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994376d9-7273-4704-96f4-068a06b94f28 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:32.286932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994376d9-7273-4704-96f4-068a06b94f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:32.309372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-994376d9-7273-4704-96f4-068a06b94f28 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:32.311172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-994376d9-7273-4704-96f4-068a06b94f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:32.330904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1192/2386] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:32.344089 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dfccb-cb53-4796-ad77-0053b5d206a1 service swift] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:32.357703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dfccb-cb53-4796-ad77-0053b5d206a1 service swift] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:32.370613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ba830-263b-405b-88ec-add870b1fa28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:32.371028 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ba830-263b-405b-88ec-add870b1fa28 service swift] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:32.371305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ba830-263b-405b-88ec-add870b1fa28 service swift] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:32.371576 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ba830-263b-405b-88ec-add870b1fa28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:32.387921 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ba830-263b-405b-88ec-add870b1fa28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:32.389913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ba830-263b-405b-88ec-add870b1fa28 service swift] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:32.390367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669a39-270f-4927-9406-c4c08e418036 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:32.390647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669a39-270f-4927-9406-c4c08e418036 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:32.390913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669a39-270f-4927-9406-c4c08e418036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:32.409205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1195/2387] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:23:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 12:23:32.451670 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e0669a39-270f-4927-9406-c4c08e418036 None None] MFA Rules not processed for user `04243556b5c0420187228f085d847cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:32.452974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e0669a39-270f-4927-9406-c4c08e418036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:32.534685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:32.548013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1193/2388] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:32.613978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ba830-263b-405b-88ec-add870b1fa28 service swift] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:32.615731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ea8ba830-263b-405b-88ec-add870b1fa28 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:32.734471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ba830-263b-405b-88ec-add870b1fa28 service swift] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:32.747075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4850e0-1da7-48a6-8f1e-75515770824f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79efccae1afa46e78c25f617bf2dd9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:32.748190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4850e0-1da7-48a6-8f1e-75515770824f service glance] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:32.748689 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4850e0-1da7-48a6-8f1e-75515770824f service glance] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:32.749140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4850e0-1da7-48a6-8f1e-75515770824f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:32.760018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:32.845870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4850e0-1da7-48a6-8f1e-75515770824f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:32.849015 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4850e0-1da7-48a6-8f1e-75515770824f service glance] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:32.861641 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1196/2389] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:33.150876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9a540-fa69-496d-93da-88de2613ac4a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:33.151322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9a540-fa69-496d-93da-88de2613ac4a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:33.151619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9a540-fa69-496d-93da-88de2613ac4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:33.166995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78be49-9a57-4525-bcb2-bfea89ccc336 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:33.167474 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78be49-9a57-4525-bcb2-bfea89ccc336 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:33.167594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78be49-9a57-4525-bcb2-bfea89ccc336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:33.183600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a5d9a540-fa69-496d-93da-88de2613ac4a None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:33.184845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a5d9a540-fa69-496d-93da-88de2613ac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:33.202575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5d78be49-9a57-4525-bcb2-bfea89ccc336 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:33.204057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5d78be49-9a57-4525-bcb2-bfea89ccc336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:33.219828 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1197/2391] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 09 12:23:33.220609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1194/2391] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 9 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:33.222543 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9a540-fa69-496d-93da-88de2613ac4a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:33.245807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78be49-9a57-4525-bcb2-bfea89ccc336 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:33.255346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9a540-fa69-496d-93da-88de2613ac4a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:33.269495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4340544-1dc0-4eeb-b271-5b59e0e165fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:33.270558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4340544-1dc0-4eeb-b271-5b59e0e165fa service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:33.271690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4340544-1dc0-4eeb-b271-5b59e0e165fa service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:33.272148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4340544-1dc0-4eeb-b271-5b59e0e165fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:33.276165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78be49-9a57-4525-bcb2-bfea89ccc336 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:33.282722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6074c-cbb5-4446-b5fa-f3da9c30eaa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:33.283342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6074c-cbb5-4446-b5fa-f3da9c30eaa8 service swift] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:33.283660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6074c-cbb5-4446-b5fa-f3da9c30eaa8 service swift] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:33.285885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4340544-1dc0-4eeb-b271-5b59e0e165fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:33.288355 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4340544-1dc0-4eeb-b271-5b59e0e165fa service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:33.288821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6074c-cbb5-4446-b5fa-f3da9c30eaa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:33.298497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1195/2392] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:23:33.298952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6074c-cbb5-4446-b5fa-f3da9c30eaa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:33.301167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6074c-cbb5-4446-b5fa-f3da9c30eaa8 service swift] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:33.311595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1198/2393] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:23:36.143924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4340544-1dc0-4eeb-b271-5b59e0e165fa service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:36.145998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a4340544-1dc0-4eeb-b271-5b59e0e165fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:36.256904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4340544-1dc0-4eeb-b271-5b59e0e165fa service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:36.262755 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:36.263745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:36.264453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:36.264964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] PATH_INFO: `/v3/users/22b0f496ab2e49a19ae9b267ef624fb8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:36.266509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b0f496ab2e49a19ae9b267ef624fb8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:36.268698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:36.344404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b0f496ab2e49a19ae9b267ef624fb8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:36.355053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b0f496ab2e49a19ae9b267ef624fb8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:36.355887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b0f496ab2e49a19ae9b267ef624fb8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:36.356894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b0f496ab2e49a19ae9b267ef624fb8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:36.379197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b0f496ab2e49a19ae9b267ef624fb8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:36.428295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1196/2394] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:36 2022] DELETE /identity/v3/users/22b0f496ab2e49a19ae9b267ef624fb8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:36.433698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275d65-b98e-4d29-a2d1-9871eceef899 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:36.434233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275d65-b98e-4d29-a2d1-9871eceef899 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:36.434775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275d65-b98e-4d29-a2d1-9871eceef899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:36.466388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a6275d65-b98e-4d29-a2d1-9871eceef899 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:36.467669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a6275d65-b98e-4d29-a2d1-9871eceef899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:36.609437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1199/2395] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:36.619428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:36.621945 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:36.846088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34d93-b281-4097-aa74-2d865be9cde7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:36.859445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a61ef-7e5d-475c-b31b-cb0a125d7b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:36.860085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a61ef-7e5d-475c-b31b-cb0a125d7b60 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:36.860361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a61ef-7e5d-475c-b31b-cb0a125d7b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:36.860647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a61ef-7e5d-475c-b31b-cb0a125d7b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:36.913313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a61ef-7e5d-475c-b31b-cb0a125d7b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:36.913313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a61ef-7e5d-475c-b31b-cb0a125d7b60 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:36.939122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1197/2396] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:37.514235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6275d65-b98e-4d29-a2d1-9871eceef899 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:37.515960 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a6275d65-b98e-4d29-a2d1-9871eceef899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:37.544998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6275d65-b98e-4d29-a2d1-9871eceef899 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:37.559190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:37.560191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:37.560686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:37.561191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] PATH_INFO: `/v3/projects/2e30b70fb5684f64b5580e08a91aa43b` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:37.567595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e30b70fb5684f64b5580e08a91aa43b)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:37.576668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:37.688126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e30b70fb5684f64b5580e08a91aa43b', 'request_id': 'req-584f666b-3e85-404b-b748-b46e81a285e6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:37.702050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e30b70fb5684f64b5580e08a91aa43b', 'request_id': 'req-584f666b-3e85-404b-b748-b46e81a285e6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:37.715761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e30b70fb5684f64b5580e08a91aa43b', 'request_id': 'req-584f666b-3e85-404b-b748-b46e81a285e6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:37.734708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] The token cache is being invalidate because project 2e30b70fb5684f64b5580e08a91aa43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:37.734999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:37.735895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-584f666b-3e85-404b-b748-b46e81a285e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:37.739628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1200/2397] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:37 2022] DELETE /identity/v3/projects/2e30b70fb5684f64b5580e08a91aa43b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:38.582945 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d37e7-3643-4bb8-84e0-c721afc218a2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:38.584124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d37e7-3643-4bb8-84e0-c721afc218a2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:38.584649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d37e7-3643-4bb8-84e0-c721afc218a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:38.595724 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:38.612063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-499d37e7-3643-4bb8-84e0-c721afc218a2 None None] MFA Rules not processed for user `7a22b52fdd5b46229d7306086ae11738`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:38.614199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-499d37e7-3643-4bb8-84e0-c721afc218a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:38.695164 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1198/2398] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:40.173782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9de0e-a613-4a4d-80e9-e3a890d6863d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:40.174347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9de0e-a613-4a4d-80e9-e3a890d6863d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:40.174347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9de0e-a613-4a4d-80e9-e3a890d6863d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:40.198480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9dd9de0e-a613-4a4d-80e9-e3a890d6863d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:40.200486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9dd9de0e-a613-4a4d-80e9-e3a890d6863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:40.209950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:40.305563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1201/2399] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:40.321560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d37e7-3643-4bb8-84e0-c721afc218a2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:40.323318 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-499d37e7-3643-4bb8-84e0-c721afc218a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:40.434378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d37e7-3643-4bb8-84e0-c721afc218a2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:40.445989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6c681-354a-41bd-aa15-716ac9861fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:40.446704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6c681-354a-41bd-aa15-716ac9861fab service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:40.447056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6c681-354a-41bd-aa15-716ac9861fab service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:40.447512 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6c681-354a-41bd-aa15-716ac9861fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:40.459931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6c681-354a-41bd-aa15-716ac9861fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:40.462663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6c681-354a-41bd-aa15-716ac9861fab service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:40.474151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1199/2400] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:43.381149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8374-2822-4db2-a2f7-5ef6e7f2d013 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:43.382931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8374-2822-4db2-a2f7-5ef6e7f2d013 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:43.383520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8374-2822-4db2-a2f7-5ef6e7f2d013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:43.427654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a84c8374-2822-4db2-a2f7-5ef6e7f2d013 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:43.430022 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a84c8374-2822-4db2-a2f7-5ef6e7f2d013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:43.439468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1202/2401] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:43.455971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6c681-354a-41bd-aa15-716ac9861fab service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:43.483658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6c681-354a-41bd-aa15-716ac9861fab service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:43.492599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b28225-f4fe-4325-8eef-ff72893c8666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:43.493623 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28225-f4fe-4325-8eef-ff72893c8666 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:43.494637 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28225-f4fe-4325-8eef-ff72893c8666 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:43.495087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28225-f4fe-4325-8eef-ff72893c8666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:43.513645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b28225-f4fe-4325-8eef-ff72893c8666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:43.515542 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b28225-f4fe-4325-8eef-ff72893c8666 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:43.536945 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1200/2402] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:45.107162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81581efa-6376-4347-99a6-e69a7dd61f37 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:45.107725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81581efa-6376-4347-99a6-e69a7dd61f37 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:45.107725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81581efa-6376-4347-99a6-e69a7dd61f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:45.126211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-81581efa-6376-4347-99a6-e69a7dd61f37 None None] MFA Rules not processed for user `a14a743ee4924fc5855c0278df7ca5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:45.127402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-81581efa-6376-4347-99a6-e69a7dd61f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:45.183585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1203/2403] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:23:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:46.695295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febdf44-a0fc-4e26-89a7-d2869302af9c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:46.695930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febdf44-a0fc-4e26-89a7-d2869302af9c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:46.695930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febdf44-a0fc-4e26-89a7-d2869302af9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:46.715462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5febdf44-a0fc-4e26-89a7-d2869302af9c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:46.716682 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5febdf44-a0fc-4e26-89a7-d2869302af9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:46.724523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1201/2404] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:46.738318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81581efa-6376-4347-99a6-e69a7dd61f37 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:46.751586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81581efa-6376-4347-99a6-e69a7dd61f37 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:46.757688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6e6dd-40a7-408a-8530-cbe99b9f1371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:46.758310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6e6dd-40a7-408a-8530-cbe99b9f1371 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:46.758590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6e6dd-40a7-408a-8530-cbe99b9f1371 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:46.758863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6e6dd-40a7-408a-8530-cbe99b9f1371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:46.766879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6e6dd-40a7-408a-8530-cbe99b9f1371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:46.768483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6e6dd-40a7-408a-8530-cbe99b9f1371 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:46.778069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1204/2405] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:49.731828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd95892-1a7f-4dbd-b72a-f0f54c3db107 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:49.732352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd95892-1a7f-4dbd-b72a-f0f54c3db107 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:49.732461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd95892-1a7f-4dbd-b72a-f0f54c3db107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:49.751546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3dd95892-1a7f-4dbd-b72a-f0f54c3db107 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:49.752988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3dd95892-1a7f-4dbd-b72a-f0f54c3db107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:49.809822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1202/2406] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:49.822170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6e6dd-40a7-408a-8530-cbe99b9f1371 service nova] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:49.823686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5de6e6dd-40a7-408a-8530-cbe99b9f1371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:49.899963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6e6dd-40a7-408a-8530-cbe99b9f1371 service nova] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:49.905398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33f8a7-e772-4c84-b162-a3e5ceac28b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:49.905992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33f8a7-e772-4c84-b162-a3e5ceac28b2 service swift] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:49.906247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33f8a7-e772-4c84-b162-a3e5ceac28b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:49.906510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33f8a7-e772-4c84-b162-a3e5ceac28b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:49.915125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33f8a7-e772-4c84-b162-a3e5ceac28b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:49.916745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33f8a7-e772-4c84-b162-a3e5ceac28b2 service swift] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:49.928408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1205/2407] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:23:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:23:50.831969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acbda6-d160-427d-8d41-4848226dcc41 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:50.832584 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acbda6-d160-427d-8d41-4848226dcc41 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:50.832584 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acbda6-d160-427d-8d41-4848226dcc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:50.854272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-48acbda6-d160-427d-8d41-4848226dcc41 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:50.855514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-48acbda6-d160-427d-8d41-4848226dcc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:50.865577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1203/2408] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:50.889450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33f8a7-e772-4c84-b162-a3e5ceac28b2 service swift] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:50.890853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4e33f8a7-e772-4c84-b162-a3e5ceac28b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:50.907023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33f8a7-e772-4c84-b162-a3e5ceac28b2 service swift] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:50.912594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522ceb5-6b4b-478a-b46c-b3d392ec1bc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:50.913757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ceb5-6b4b-478a-b46c-b3d392ec1bc5 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:50.914037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ceb5-6b4b-478a-b46c-b3d392ec1bc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:50.914306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ceb5-6b4b-478a-b46c-b3d392ec1bc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:50.923199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522ceb5-6b4b-478a-b46c-b3d392ec1bc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:50.924838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522ceb5-6b4b-478a-b46c-b3d392ec1bc5 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:50.937076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1206/2409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:00.847975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:00.932539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=93 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:05.351263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ceb86-a9db-463e-9872-566354aa3dc9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:05.352477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ceb86-a9db-463e-9872-566354aa3dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:05.352477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ceb86-a9db-463e-9872-566354aa3dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:05.372188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d16ceb86-a9db-463e-9872-566354aa3dc9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:05.373417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d16ceb86-a9db-463e-9872-566354aa3dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:05.383616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1204/2410] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:24:05.545769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522ceb5-6b4b-478a-b46c-b3d392ec1bc5 service nova] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:05.558892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522ceb5-6b4b-478a-b46c-b3d392ec1bc5 service nova] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:05.564884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea699c4-5f91-4ced-9a17-c26828dbd3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:05.565504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea699c4-5f91-4ced-9a17-c26828dbd3e9 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:05.565784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea699c4-5f91-4ced-9a17-c26828dbd3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:05.566052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea699c4-5f91-4ced-9a17-c26828dbd3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:05.576278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea699c4-5f91-4ced-9a17-c26828dbd3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:05.578054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea699c4-5f91-4ced-9a17-c26828dbd3e9 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:05.588470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1207/2411] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:08.516967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbfbe1-2f4c-4d93-a3f8-235e03c3e0d7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:08.517468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbfbe1-2f4c-4d93-a3f8-235e03c3e0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:08.517552 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbfbe1-2f4c-4d93-a3f8-235e03c3e0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:08.537342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-87fbfbe1-2f4c-4d93-a3f8-235e03c3e0d7 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:08.538573 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-87fbfbe1-2f4c-4d93-a3f8-235e03c3e0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:08.546493 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1205/2412] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:08.561561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea699c4-5f91-4ced-9a17-c26828dbd3e9 service nova] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:08.573678 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea699c4-5f91-4ced-9a17-c26828dbd3e9 service nova] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:08.579793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b8165-2b0e-44a7-b27e-c661c0b3b6d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:08.580402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b8165-2b0e-44a7-b27e-c661c0b3b6d0 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:08.580770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b8165-2b0e-44a7-b27e-c661c0b3b6d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:08.580970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b8165-2b0e-44a7-b27e-c661c0b3b6d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:08.592470 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b8165-2b0e-44a7-b27e-c661c0b3b6d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:08.594184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b8165-2b0e-44a7-b27e-c661c0b3b6d0 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:08.606004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1208/2413] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:18.531842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=6 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:18.600603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=12 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:23.024242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbfbe1-2f4c-4d93-a3f8-235e03c3e0d7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:23.025807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-87fbfbe1-2f4c-4d93-a3f8-235e03c3e0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:23.089184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbfbe1-2f4c-4d93-a3f8-235e03c3e0d7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:23.093212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5b0b9-0901-48e3-80ad-1e994084f312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:23.094367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5b0b9-0901-48e3-80ad-1e994084f312 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:23.094949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5b0b9-0901-48e3-80ad-1e994084f312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:23.095497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5b0b9-0901-48e3-80ad-1e994084f312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:23.097641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cce5b0b9-0901-48e3-80ad-1e994084f312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:23.193474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5b0b9-0901-48e3-80ad-1e994084f312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:23.196231 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5b0b9-0901-48e3-80ad-1e994084f312 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:23.212003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1206/2414] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:25.094523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f53ce-40ce-4ce7-80a6-bee59cf2ef42 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:25.095046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f53ce-40ce-4ce7-80a6-bee59cf2ef42 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:25.095159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f53ce-40ce-4ce7-80a6-bee59cf2ef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:25.157191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-506f53ce-40ce-4ce7-80a6-bee59cf2ef42 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:25.158551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-506f53ce-40ce-4ce7-80a6-bee59cf2ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:25.199762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1209/2415] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:25.216129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5b0b9-0901-48e3-80ad-1e994084f312 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:25.234563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5b0b9-0901-48e3-80ad-1e994084f312 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:25.250532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f59fcf-f21b-4508-b449-89b232d7fd7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:25.251310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f59fcf-f21b-4508-b449-89b232d7fd7d service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:25.251700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f59fcf-f21b-4508-b449-89b232d7fd7d service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:25.252074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f59fcf-f21b-4508-b449-89b232d7fd7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:25.271127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f59fcf-f21b-4508-b449-89b232d7fd7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:25.273791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f59fcf-f21b-4508-b449-89b232d7fd7d service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:25.306429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1207/2416] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:24:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:24:27.790057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca202f-2e4a-4102-bb90-9fb273d14a71 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.791094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca202f-2e4a-4102-bb90-9fb273d14a71 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.791584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca202f-2e4a-4102-bb90-9fb273d14a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.818191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-b2ca202f-2e4a-4102-bb90-9fb273d14a71 None None] MFA Rules not processed for user `989218c1a1f54a7eb211a49b2c753faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:27.820511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b2ca202f-2e4a-4102-bb90-9fb273d14a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:27.947539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1210/2417] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 09 12:24:35.288307 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=56 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:36.268716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804729-49c8-4a7b-a02e-74889e563782 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:36.269581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804729-49c8-4a7b-a02e-74889e563782 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:36.270023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804729-49c8-4a7b-a02e-74889e563782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:36.291662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-4f804729-49c8-4a7b-a02e-74889e563782 None None] MFA Rules not processed for user `fcedc1966e19490fb739046a3379b135`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:36.293714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-4f804729-49c8-4a7b-a02e-74889e563782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:36.367450 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1208/2418] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:37.929543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=28 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:41.966483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca202f-2e4a-4102-bb90-9fb273d14a71 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:41.968051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b2ca202f-2e4a-4102-bb90-9fb273d14a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:42.057367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca202f-2e4a-4102-bb90-9fb273d14a71 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:42.063650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c772e-10a3-4173-801f-906d185807ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:42.064143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c772e-10a3-4173-801f-906d185807ce service placement] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:42.064530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c772e-10a3-4173-801f-906d185807ce service placement] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:42.064941 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c772e-10a3-4173-801f-906d185807ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:42.066779 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d73c772e-10a3-4173-801f-906d185807ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:42.080389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c772e-10a3-4173-801f-906d185807ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:42.082129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c772e-10a3-4173-801f-906d185807ce service placement] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:42.092911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1211/2419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:43.545618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dcab0-eed4-46c0-bf8a-b899f4b4bdc4 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:43.548536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dcab0-eed4-46c0-bf8a-b899f4b4bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:43.549505 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dcab0-eed4-46c0-bf8a-b899f4b4bdc4 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:43.551230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1209/2420] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:24:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:24:43.565397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3728a-7dc8-4ab3-a0c7-476d9408f30b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:43.565925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3728a-7dc8-4ab3-a0c7-476d9408f30b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:43.565925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3728a-7dc8-4ab3-a0c7-476d9408f30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:43.591233 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-23b3728a-7dc8-4ab3-a0c7-476d9408f30b None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:43.593054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-23b3728a-7dc8-4ab3-a0c7-476d9408f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:43.611319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1212/2421] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:43.618756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dcab0-eed4-46c0-bf8a-b899f4b4bdc4 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:43.620580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-295dcab0-eed4-46c0-bf8a-b899f4b4bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:43.727742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dcab0-eed4-46c0-bf8a-b899f4b4bdc4 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:43.731949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab4498-dcab-473c-a156-a0fb5fca6b93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79efccae1afa46e78c25f617bf2dd9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:43.732892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4498-dcab-473c-a156-a0fb5fca6b93 service glance] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:43.733389 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4498-dcab-473c-a156-a0fb5fca6b93 service glance] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:43.733870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab4498-dcab-473c-a156-a0fb5fca6b93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:43.754586 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab4498-dcab-473c-a156-a0fb5fca6b93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:43.756110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab4498-dcab-473c-a156-a0fb5fca6b93 service glance] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:43.777410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1210/2422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:43.856721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b58a1a-0ac5-4177-8119-2f084c34170c None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:43.858526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b58a1a-0ac5-4177-8119-2f084c34170c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:43.858971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b58a1a-0ac5-4177-8119-2f084c34170c None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:43.860372 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1213/2423] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:24:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:24:43.865301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9ba7-39ac-4f52-b440-865e58b52163 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:43.865579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9ba7-39ac-4f52-b440-865e58b52163 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:43.865849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9ba7-39ac-4f52-b440-865e58b52163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:43.886304 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-169a9ba7-39ac-4f52-b440-865e58b52163 None None] MFA Rules not processed for user `13063cbf860c4ca98666500c3c125933`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:43.887606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-169a9ba7-39ac-4f52-b440-865e58b52163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:43.894440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1211/2424] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:24:43.906934 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b58a1a-0ac5-4177-8119-2f084c34170c None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:43.908702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a3b58a1a-0ac5-4177-8119-2f084c34170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:43.921638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b58a1a-0ac5-4177-8119-2f084c34170c None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:43.925577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543158a-cd70-42a9-a7ad-633615232976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:43.926163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543158a-cd70-42a9-a7ad-633615232976 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:43.926434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543158a-cd70-42a9-a7ad-633615232976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:43.926696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543158a-cd70-42a9-a7ad-633615232976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:43.933909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543158a-cd70-42a9-a7ad-633615232976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:43.935317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543158a-cd70-42a9-a7ad-633615232976 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:43.943012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1214/2425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:44.027083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584b1d-11ec-45bd-81bf-bf170d0ba7c3 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:44.027365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584b1d-11ec-45bd-81bf-bf170d0ba7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:44.027639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584b1d-11ec-45bd-81bf-bf170d0ba7c3 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:44.029050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1212/2426] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:24:44.034356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9863f-5b73-4da9-86fc-45482776bf0d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:44.034643 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9863f-5b73-4da9-86fc-45482776bf0d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:44.034938 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9863f-5b73-4da9-86fc-45482776bf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:44.054371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-65d9863f-5b73-4da9-86fc-45482776bf0d None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:44.055555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-65d9863f-5b73-4da9-86fc-45482776bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:44.064670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1215/2427] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:44.077012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584b1d-11ec-45bd-81bf-bf170d0ba7c3 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:44.088608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584b1d-11ec-45bd-81bf-bf170d0ba7c3 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:44.092331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0590-fe73-4f25-99ae-15cd2645c254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:44.092986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0590-fe73-4f25-99ae-15cd2645c254 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:44.093263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0590-fe73-4f25-99ae-15cd2645c254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:44.093530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0590-fe73-4f25-99ae-15cd2645c254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:44.103821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0590-fe73-4f25-99ae-15cd2645c254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:44.105272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0590-fe73-4f25-99ae-15cd2645c254 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:44.115755 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1213/2428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:46.381226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6adc62-553d-4e22-a914-a9834ccb3125 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:46.382355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6adc62-553d-4e22-a914-a9834ccb3125 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:46.382355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6adc62-553d-4e22-a914-a9834ccb3125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:46.403371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-8c6adc62-553d-4e22-a914-a9834ccb3125 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:46.404581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8c6adc62-553d-4e22-a914-a9834ccb3125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:46.412421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1216/2429] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:24:46.427302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0590-fe73-4f25-99ae-15cd2645c254 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:46.439256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0590-fe73-4f25-99ae-15cd2645c254 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:46.450954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb6c9-e803-4d37-a977-8ea424e8847c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:46.451580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb6c9-e803-4d37-a977-8ea424e8847c service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:46.451848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb6c9-e803-4d37-a977-8ea424e8847c service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:46.452113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb6c9-e803-4d37-a977-8ea424e8847c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:46.461182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb6c9-e803-4d37-a977-8ea424e8847c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:46.462764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb6c9-e803-4d37-a977-8ea424e8847c service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:46.473251 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1214/2430] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:48.469148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4270577-51d1-4fe9-bd90-abb93d0e3d67 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:48.469636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4270577-51d1-4fe9-bd90-abb93d0e3d67 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:48.469806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4270577-51d1-4fe9-bd90-abb93d0e3d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:48.489207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c4270577-51d1-4fe9-bd90-abb93d0e3d67 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:48.490442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c4270577-51d1-4fe9-bd90-abb93d0e3d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:48.499628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1217/2431] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:24:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:48.511320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb6c9-e803-4d37-a977-8ea424e8847c service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:48.523198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb6c9-e803-4d37-a977-8ea424e8847c service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:48.528534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352015d-f8c8-4643-80bd-4e8b6bb0ef52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:48.529166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352015d-f8c8-4643-80bd-4e8b6bb0ef52 service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:48.529506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352015d-f8c8-4643-80bd-4e8b6bb0ef52 service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:48.529856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352015d-f8c8-4643-80bd-4e8b6bb0ef52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:48.538670 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352015d-f8c8-4643-80bd-4e8b6bb0ef52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:48.540354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352015d-f8c8-4643-80bd-4e8b6bb0ef52 service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:48.549497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1215/2432] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:24:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:24:49.756439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c8d12-8d82-4ea2-9625-b5077dbde6c3 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:49.757287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c8d12-8d82-4ea2-9625-b5077dbde6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:49.757287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c8d12-8d82-4ea2-9625-b5077dbde6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:49.794355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-801c8d12-8d82-4ea2-9625-b5077dbde6c3 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:49.796102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-801c8d12-8d82-4ea2-9625-b5077dbde6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:49.805386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1218/2433] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:49.821463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352015d-f8c8-4643-80bd-4e8b6bb0ef52 service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:49.846625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352015d-f8c8-4643-80bd-4e8b6bb0ef52 service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:49.852181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdf07a-e492-4251-a2d8-440b15aac0a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:49.852813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdf07a-e492-4251-a2d8-440b15aac0a5 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:49.853092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdf07a-e492-4251-a2d8-440b15aac0a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:49.853364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdf07a-e492-4251-a2d8-440b15aac0a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:49.862033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdf07a-e492-4251-a2d8-440b15aac0a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:49.863598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdf07a-e492-4251-a2d8-440b15aac0a5 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:49.873504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1216/2434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:59.781390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=53 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:59.869209 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=78 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:04.166790 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacd426-489a-44d9-afa7-e8b0a6490d4c None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:04.167382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacd426-489a-44d9-afa7-e8b0a6490d4c None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:04.167382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacd426-489a-44d9-afa7-e8b0a6490d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:04.188002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5dacd426-489a-44d9-afa7-e8b0a6490d4c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:04.189212 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5dacd426-489a-44d9-afa7-e8b0a6490d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:04.197640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1219/2435] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:04.213103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdf07a-e492-4251-a2d8-440b15aac0a5 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:04.224012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdf07a-e492-4251-a2d8-440b15aac0a5 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:04.230593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a3b8-b128-48e7-ab87-6202287cf2f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:04.231280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a3b8-b128-48e7-ab87-6202287cf2f1 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:04.231622 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a3b8-b128-48e7-ab87-6202287cf2f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:04.231895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a3b8-b128-48e7-ab87-6202287cf2f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:04.240341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6a3b8-b128-48e7-ab87-6202287cf2f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:04.241920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6a3b8-b128-48e7-ab87-6202287cf2f1 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:04.251519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1217/2436] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:08.407214 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d456f6-f4a7-49d0-8eb5-e03c9d10d6da None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:08.407693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d456f6-f4a7-49d0-8eb5-e03c9d10d6da None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:08.407806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d456f6-f4a7-49d0-8eb5-e03c9d10d6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:08.427761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-29d456f6-f4a7-49d0-8eb5-e03c9d10d6da None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:08.428980 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-29d456f6-f4a7-49d0-8eb5-e03c9d10d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:08.436940 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1220/2437] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:08.451130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a3b8-b128-48e7-ab87-6202287cf2f1 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:08.462902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a3b8-b128-48e7-ab87-6202287cf2f1 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:08.468286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4519daa-b63e-4b29-8064-804180b9df76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:08.468942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4519daa-b63e-4b29-8064-804180b9df76 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:08.469223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4519daa-b63e-4b29-8064-804180b9df76 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:08.469493 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4519daa-b63e-4b29-8064-804180b9df76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:08.478087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4519daa-b63e-4b29-8064-804180b9df76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:08.480352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4519daa-b63e-4b29-8064-804180b9df76 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:08.490371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1218/2438] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:08.756164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8df0-84ab-441e-af07-879118d43b05 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:08.756451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8df0-84ab-441e-af07-879118d43b05 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:08.756760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8df0-84ab-441e-af07-879118d43b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:08.777038 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-dd8c8df0-84ab-441e-af07-879118d43b05 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:08.778245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-dd8c8df0-84ab-441e-af07-879118d43b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:08.785369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1221/2439] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 9 12:25:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:08.797587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4519daa-b63e-4b29-8064-804180b9df76 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:08.815332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4519daa-b63e-4b29-8064-804180b9df76 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:08.820373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6924d-08ec-46ae-ab97-7fa1fcbd4ab7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:08.821631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6924d-08ec-46ae-ab97-7fa1fcbd4ab7 service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:08.821908 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6924d-08ec-46ae-ab97-7fa1fcbd4ab7 service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:08.822178 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6924d-08ec-46ae-ab97-7fa1fcbd4ab7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:08.830463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6924d-08ec-46ae-ab97-7fa1fcbd4ab7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:08.832050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6924d-08ec-46ae-ab97-7fa1fcbd4ab7 service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:08.840222 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1219/2440] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:25:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:25:12.595481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77b9e-c8d3-42bf-a028-a8db1bac0432 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:12.595964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77b9e-c8d3-42bf-a028-a8db1bac0432 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:12.596078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77b9e-c8d3-42bf-a028-a8db1bac0432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:12.615532 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a3b77b9e-c8d3-42bf-a028-a8db1bac0432 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:12.616761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a3b77b9e-c8d3-42bf-a028-a8db1bac0432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:12.625291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1222/2441] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 12:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:12.647634 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6924d-08ec-46ae-ab97-7fa1fcbd4ab7 service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:12.660118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6924d-08ec-46ae-ab97-7fa1fcbd4ab7 service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:12.666103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b29ddb-f933-4adc-8a2c-0a8005606e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:12.666694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b29ddb-f933-4adc-8a2c-0a8005606e44 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:12.666972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b29ddb-f933-4adc-8a2c-0a8005606e44 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:12.667244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b29ddb-f933-4adc-8a2c-0a8005606e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:12.675533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b29ddb-f933-4adc-8a2c-0a8005606e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:12.677143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b29ddb-f933-4adc-8a2c-0a8005606e44 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:12.686411 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1220/2442] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:22.610506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=12 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:22.682352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=24 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:30.908407 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec0af7-cba4-4af6-b93f-fab3739c84cc None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:30.908977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec0af7-cba4-4af6-b93f-fab3739c84cc None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:30.908977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec0af7-cba4-4af6-b93f-fab3739c84cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:30.928207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-99ec0af7-cba4-4af6-b93f-fab3739c84cc None None] MFA Rules not processed for user `7a22b52fdd5b46229d7306086ae11738`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:30.929590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-99ec0af7-cba4-4af6-b93f-fab3739c84cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:30.936493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1223/2443] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:25:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:40.922897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:41.791271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d2202-0f00-4a97-b5c9-3c9b15c67314 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:41.791783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d2202-0f00-4a97-b5c9-3c9b15c67314 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:41.791901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d2202-0f00-4a97-b5c9-3c9b15c67314 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:41.793242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1221/2444] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:25:41.803276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6768-ff64-4f0a-a552-434076f057b8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:41.803605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6768-ff64-4f0a-a552-434076f057b8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:41.804074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6768-ff64-4f0a-a552-434076f057b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:41.823937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-175f6768-ff64-4f0a-a552-434076f057b8 None None] MFA Rules not processed for user `c7f2e22ace8648919104c910c74c1711`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:41.825200 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-175f6768-ff64-4f0a-a552-434076f057b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:41.834687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1224/2445] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:25:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:41.851478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d2202-0f00-4a97-b5c9-3c9b15c67314 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:41.853274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1c5d2202-0f00-4a97-b5c9-3c9b15c67314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:41.869368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6768-ff64-4f0a-a552-434076f057b8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:41.871144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-175f6768-ff64-4f0a-a552-434076f057b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:41.873727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d2202-0f00-4a97-b5c9-3c9b15c67314 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:41.879372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927552-c355-4766-b65c-c13c398e0f52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:41.880163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927552-c355-4766-b65c-c13c398e0f52 service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:41.880603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927552-c355-4766-b65c-c13c398e0f52 service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:41.881357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927552-c355-4766-b65c-c13c398e0f52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:41.888142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6768-ff64-4f0a-a552-434076f057b8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:41.891005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02927552-c355-4766-b65c-c13c398e0f52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:41.892578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02927552-c355-4766-b65c-c13c398e0f52 service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:41.892794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:41.893420 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:41.893701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:41.893971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] PATH_INFO: `/v3/users/989218c1a1f54a7eb211a49b2c753faf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:41.895097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989218c1a1f54a7eb211a49b2c753faf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:41.897077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:41.903053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1222/2446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:41.945461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989218c1a1f54a7eb211a49b2c753faf'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:41.953661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989218c1a1f54a7eb211a49b2c753faf'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:41.954286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989218c1a1f54a7eb211a49b2c753faf'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:41.954893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989218c1a1f54a7eb211a49b2c753faf'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:41.961834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0163c5d3-ffef-470b-acad-36695894ff24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989218c1a1f54a7eb211a49b2c753faf'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:41.978679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1225/2447] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:25:41 2022] DELETE /identity/v3/users/989218c1a1f54a7eb211a49b2c753faf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:25:42.158984 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927552-c355-4766-b65c-c13c398e0f52 service placement] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:42.170530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927552-c355-4766-b65c-c13c398e0f52 service placement] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:42.232368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:42.233034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.233311 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.233578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] PATH_INFO: `/v3/projects/9e724bddf8ea447a81793b44af8266af` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.234680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e724bddf8ea447a81793b44af8266af)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:42.236565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:42.281876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e724bddf8ea447a81793b44af8266af', 'request_id': 'req-2668b982-cafe-4baa-ade4-a12598fa10ea'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:42.287314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e724bddf8ea447a81793b44af8266af', 'request_id': 'req-2668b982-cafe-4baa-ade4-a12598fa10ea'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:42.294614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e724bddf8ea447a81793b44af8266af', 'request_id': 'req-2668b982-cafe-4baa-ade4-a12598fa10ea'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:42.306146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] The token cache is being invalidate because project 9e724bddf8ea447a81793b44af8266af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:25:42.306436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:42.307053 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2668b982-cafe-4baa-ade4-a12598fa10ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:42.308527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1223/2448] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:25:42 2022] DELETE /identity/v3/projects/9e724bddf8ea447a81793b44af8266af => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:42.313903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765212-45f0-4dea-a53b-cb6d262b9911 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.314194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765212-45f0-4dea-a53b-cb6d262b9911 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.314466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765212-45f0-4dea-a53b-cb6d262b9911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.334781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d5765212-45f0-4dea-a53b-cb6d262b9911 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:42.336648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d5765212-45f0-4dea-a53b-cb6d262b9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:42.393749 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1226/2449] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:42.402431 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955ab50-33a9-4423-9b3c-806b2d67f1e7 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.402777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955ab50-33a9-4423-9b3c-806b2d67f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.403055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955ab50-33a9-4423-9b3c-806b2d67f1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.422910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2955ab50-33a9-4423-9b3c-806b2d67f1e7 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:42.424109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2955ab50-33a9-4423-9b3c-806b2d67f1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:42.432398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1224/2450] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:42.436805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5765212-45f0-4dea-a53b-cb6d262b9911 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:42.447098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5765212-45f0-4dea-a53b-cb6d262b9911 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:42.451613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d179-bef6-4899-869f-ef4748cd7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:42.452202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d179-bef6-4899-869f-ef4748cd7ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.452478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d179-bef6-4899-869f-ef4748cd7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.452784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d179-bef6-4899-869f-ef4748cd7ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.453422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2d179-bef6-4899-869f-ef4748cd7ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:25:42.453722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2d179-bef6-4899-869f-ef4748cd7ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:42.455305 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2d179-bef6-4899-869f-ef4748cd7ddf admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:42.467468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1227/2451] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:25:42.471590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955ab50-33a9-4423-9b3c-806b2d67f1e7 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:42.481713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955ab50-33a9-4423-9b3c-806b2d67f1e7 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:42.486356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f53632-11c4-49b1-bffa-1505fbbed915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:42.486952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53632-11c4-49b1-bffa-1505fbbed915 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.487230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53632-11c4-49b1-bffa-1505fbbed915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.487505 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53632-11c4-49b1-bffa-1505fbbed915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.488133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f53632-11c4-49b1-bffa-1505fbbed915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:42.490180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f53632-11c4-49b1-bffa-1505fbbed915 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:42.520701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1225/2452] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:25:42 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:25:42.521796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d179-bef6-4899-869f-ef4748cd7ddf admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:42.531766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d179-bef6-4899-869f-ef4748cd7ddf admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:42.578380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:42.588292 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e24f22-fd8a-4d67-9dc5-b7203eef03cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:42.588948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e24f22-fd8a-4d67-9dc5-b7203eef03cf admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.589260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e24f22-fd8a-4d67-9dc5-b7203eef03cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.589529 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e24f22-fd8a-4d67-9dc5-b7203eef03cf admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.590140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e24f22-fd8a-4d67-9dc5-b7203eef03cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:42.592057 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e24f22-fd8a-4d67-9dc5-b7203eef03cf admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:42.612230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1228/2453] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:25:42 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:25:42.616312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f53632-11c4-49b1-bffa-1505fbbed915 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:42.627394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f53632-11c4-49b1-bffa-1505fbbed915 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:42.632069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7a0cb-2666-485e-a0ee-e1bf08720f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:42.632790 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7a0cb-2666-485e-a0ee-e1bf08720f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.633073 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7a0cb-2666-485e-a0ee-e1bf08720f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.633344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7a0cb-2666-485e-a0ee-e1bf08720f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.633996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7a0cb-2666-485e-a0ee-e1bf08720f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:42.635566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7a0cb-2666-485e-a0ee-e1bf08720f23 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:42.645420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1226/2454] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:25:42.649728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e24f22-fd8a-4d67-9dc5-b7203eef03cf admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:42.659628 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e24f22-fd8a-4d67-9dc5-b7203eef03cf admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:42.664840 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26688e43-94e1-4d7d-ab99-9df15d0f0759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:42.665427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26688e43-94e1-4d7d-ab99-9df15d0f0759 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.665700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26688e43-94e1-4d7d-ab99-9df15d0f0759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.665965 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26688e43-94e1-4d7d-ab99-9df15d0f0759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.666593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26688e43-94e1-4d7d-ab99-9df15d0f0759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:42.668173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26688e43-94e1-4d7d-ab99-9df15d0f0759 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:42.679088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1229/2455] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:25:42.683124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7a0cb-2666-485e-a0ee-e1bf08720f23 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:42.693011 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7a0cb-2666-485e-a0ee-e1bf08720f23 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:42.697785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a1024-2fd3-43b1-8a95-d5c8ae581a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:42.698415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a1024-2fd3-43b1-8a95-d5c8ae581a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.698690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a1024-2fd3-43b1-8a95-d5c8ae581a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.698953 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a1024-2fd3-43b1-8a95-d5c8ae581a46 admin admin] PATH_INFO: `/v3/projects/d7a8bf1f0c0f4f61b70cca7ae41ba072/users/27cd2e122c0e4853a2c5b48734aa9b11/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.713775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a1024-2fd3-43b1-8a95-d5c8ae581a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a8bf1f0c0f4f61b70cca7ae41ba072, user_id=27cd2e122c0e4853a2c5b48734aa9b11, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:42.716376 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a1024-2fd3-43b1-8a95-d5c8ae581a46 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:42.729511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1227/2456] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:25:42 2022] PUT /identity/v3/projects/d7a8bf1f0c0f4f61b70cca7ae41ba072/users/27cd2e122c0e4853a2c5b48734aa9b11/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:25:42.734423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86d5a-0d53-4b65-ba49-27756e2cc92e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.734703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86d5a-0d53-4b65-ba49-27756e2cc92e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.734971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86d5a-0d53-4b65-ba49-27756e2cc92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.753338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a6f86d5a-0d53-4b65-ba49-27756e2cc92e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:42.754522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a6f86d5a-0d53-4b65-ba49-27756e2cc92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:42.811649 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1230/2457] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:42.821358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a1024-2fd3-43b1-8a95-d5c8ae581a46 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:42.823219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-410a1024-2fd3-43b1-8a95-d5c8ae581a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:42.838740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:42.883252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a1024-2fd3-43b1-8a95-d5c8ae581a46 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:42.886896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46cae5-592d-4311-a496-dab41c7b93a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:42.887494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46cae5-592d-4311-a496-dab41c7b93a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:42.887773 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46cae5-592d-4311-a496-dab41c7b93a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:42.888042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46cae5-592d-4311-a496-dab41c7b93a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:42.896968 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46cae5-592d-4311-a496-dab41c7b93a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:42.898902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46cae5-592d-4311-a496-dab41c7b93a0 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:42.908284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1228/2458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:47.036900 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0440af-4e9b-4bd7-ac43-db12dca53de4 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:47.037493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0440af-4e9b-4bd7-ac43-db12dca53de4 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:47.037761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0440af-4e9b-4bd7-ac43-db12dca53de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:47.075191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ad0440af-4e9b-4bd7-ac43-db12dca53de4 None None] MFA Rules not processed for user `27cd2e122c0e4853a2c5b48734aa9b11`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:47.078641 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ad0440af-4e9b-4bd7-ac43-db12dca53de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:47.161781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1231/2459] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:47.167029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46cae5-592d-4311-a496-dab41c7b93a0 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:47.178772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46cae5-592d-4311-a496-dab41c7b93a0 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:47.183836 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147e176-fca8-4f2c-8a95-10cb4158cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:47.184446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147e176-fca8-4f2c-8a95-10cb4158cab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:47.184766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147e176-fca8-4f2c-8a95-10cb4158cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:47.185038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147e176-fca8-4f2c-8a95-10cb4158cab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:47.185663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147e176-fca8-4f2c-8a95-10cb4158cab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:47.187563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147e176-fca8-4f2c-8a95-10cb4158cab8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:47.222674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1229/2460] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:25:47 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:25:47.227718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0440af-4e9b-4bd7-ac43-db12dca53de4 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:47.250666 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0440af-4e9b-4bd7-ac43-db12dca53de4 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:47.337866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03099b-16d9-4768-82b6-7e7e6ca0de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:47.338580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03099b-16d9-4768-82b6-7e7e6ca0de4a admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:47.338930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03099b-16d9-4768-82b6-7e7e6ca0de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:47.339273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03099b-16d9-4768-82b6-7e7e6ca0de4a admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:47.340032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03099b-16d9-4768-82b6-7e7e6ca0de4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:47.342179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03099b-16d9-4768-82b6-7e7e6ca0de4a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:47.353222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:47.366755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1232/2461] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:25:47 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:25:47.370770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147e176-fca8-4f2c-8a95-10cb4158cab8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:47.383020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147e176-fca8-4f2c-8a95-10cb4158cab8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:47.387629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b6b4d-99dd-4b93-aba4-c26f3ec1da7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:47.388266 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b6b4d-99dd-4b93-aba4-c26f3ec1da7c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:47.388542 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b6b4d-99dd-4b93-aba4-c26f3ec1da7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:47.388838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b6b4d-99dd-4b93-aba4-c26f3ec1da7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:47.389475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b6b4d-99dd-4b93-aba4-c26f3ec1da7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:47.391059 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b6b4d-99dd-4b93-aba4-c26f3ec1da7c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:47.403198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1230/2462] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:25:47.407635 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03099b-16d9-4768-82b6-7e7e6ca0de4a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:47.426182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03099b-16d9-4768-82b6-7e7e6ca0de4a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:47.434781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747082e-57c6-4f2e-9dbb-013e15f99e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:47.435557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747082e-57c6-4f2e-9dbb-013e15f99e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:47.435907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747082e-57c6-4f2e-9dbb-013e15f99e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:47.436249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747082e-57c6-4f2e-9dbb-013e15f99e18 admin admin] PATH_INFO: `/v3/projects/55cf287a0a1a42da8022dd3dbd1204db/users/aee83691ac684778b6d8384f27a675d7/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:47.452471 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747082e-57c6-4f2e-9dbb-013e15f99e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cf287a0a1a42da8022dd3dbd1204db, user_id=aee83691ac684778b6d8384f27a675d7, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:47.455754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747082e-57c6-4f2e-9dbb-013e15f99e18 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:47.470452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1233/2463] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:25:47 2022] PUT /identity/v3/projects/55cf287a0a1a42da8022dd3dbd1204db/users/aee83691ac684778b6d8384f27a675d7/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:47.474144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b6b4d-99dd-4b93-aba4-c26f3ec1da7c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:47.484978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b6b4d-99dd-4b93-aba4-c26f3ec1da7c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:47.544230 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0f75b-434f-40bf-b7c1-6cd9de31dd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:47.544949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0f75b-434f-40bf-b7c1-6cd9de31dd3b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:47.545225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0f75b-434f-40bf-b7c1-6cd9de31dd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:47.545503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0f75b-434f-40bf-b7c1-6cd9de31dd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:47.546123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0f75b-434f-40bf-b7c1-6cd9de31dd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:47.547744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0f75b-434f-40bf-b7c1-6cd9de31dd3b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:47.562838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1231/2464] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:25:47.564077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747082e-57c6-4f2e-9dbb-013e15f99e18 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:47.575555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747082e-57c6-4f2e-9dbb-013e15f99e18 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:47.580902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa203679-798e-4e70-aca2-0b5150101fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:47.581595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa203679-798e-4e70-aca2-0b5150101fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:47.581872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa203679-798e-4e70-aca2-0b5150101fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:47.582147 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa203679-798e-4e70-aca2-0b5150101fa0 admin admin] PATH_INFO: `/v3/projects/55cf287a0a1a42da8022dd3dbd1204db/users/aee83691ac684778b6d8384f27a675d7/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:47.584068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa203679-798e-4e70-aca2-0b5150101fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cf287a0a1a42da8022dd3dbd1204db, user_id=aee83691ac684778b6d8384f27a675d7, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:47.587322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa203679-798e-4e70-aca2-0b5150101fa0 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:47.599842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1234/2465] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:25:47 2022] PUT /identity/v3/projects/55cf287a0a1a42da8022dd3dbd1204db/users/aee83691ac684778b6d8384f27a675d7/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:52.473799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fd6a-ed6e-4e27-962f-e91ed2573083 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:52.474322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fd6a-ed6e-4e27-962f-e91ed2573083 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:52.474418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fd6a-ed6e-4e27-962f-e91ed2573083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:52.504388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-99c6fd6a-ed6e-4e27-962f-e91ed2573083 None None] MFA Rules not processed for user `aee83691ac684778b6d8384f27a675d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:52.505665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-99c6fd6a-ed6e-4e27-962f-e91ed2573083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:52.594651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1232/2466] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:52.608396 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa203679-798e-4e70-aca2-0b5150101fa0 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:52.610188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-fa203679-798e-4e70-aca2-0b5150101fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:52.723625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa203679-798e-4e70-aca2-0b5150101fa0 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:52.731361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87ba04-20a7-4489-9678-6ccdea860240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:52.732122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87ba04-20a7-4489-9678-6ccdea860240 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:52.732464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87ba04-20a7-4489-9678-6ccdea860240 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:52.732831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87ba04-20a7-4489-9678-6ccdea860240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:52.804032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87ba04-20a7-4489-9678-6ccdea860240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:52.805990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87ba04-20a7-4489-9678-6ccdea860240 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:52.816128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1235/2467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:53.941804 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303cf7d-27ee-4aeb-a40a-d54639577f66 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:53.942320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303cf7d-27ee-4aeb-a40a-d54639577f66 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:53.942320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303cf7d-27ee-4aeb-a40a-d54639577f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:53.952072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:53.963760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a303cf7d-27ee-4aeb-a40a-d54639577f66 None None] MFA Rules not processed for user `27cd2e122c0e4853a2c5b48734aa9b11`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:53.964997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a303cf7d-27ee-4aeb-a40a-d54639577f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:53.971828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1233/2468] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:59.074443 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34892384-8b76-4908-a20c-5265fc008fbe None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:59.074927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34892384-8b76-4908-a20c-5265fc008fbe None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:59.075020 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34892384-8b76-4908-a20c-5265fc008fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:59.093981 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-34892384-8b76-4908-a20c-5265fc008fbe None None] MFA Rules not processed for user `d401f4d03dfc4391af76a99c91eb37e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:59.095258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-34892384-8b76-4908-a20c-5265fc008fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:59.141357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:59.153357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1236/2469] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:25:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:03.961808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:04.598147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c8f5d-04f5-4e8d-9d5c-7aed057518be None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:04.598434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c8f5d-04f5-4e8d-9d5c-7aed057518be None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:04.598706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c8f5d-04f5-4e8d-9d5c-7aed057518be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:04.619051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-271c8f5d-04f5-4e8d-9d5c-7aed057518be None None] MFA Rules not processed for user `fcedc1966e19490fb739046a3379b135`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:04.620260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-271c8f5d-04f5-4e8d-9d5c-7aed057518be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:04.698149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1234/2470] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:26:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:09.149195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:14.687438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=25 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:24.663601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34892384-8b76-4908-a20c-5265fc008fbe None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:24.723961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34892384-8b76-4908-a20c-5265fc008fbe None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:24.728431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2199c58-95b7-44ec-804e-b1af45f11d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:24.729068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2199c58-95b7-44ec-804e-b1af45f11d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:24.729347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2199c58-95b7-44ec-804e-b1af45f11d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:24.729616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2199c58-95b7-44ec-804e-b1af45f11d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:24.740585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2199c58-95b7-44ec-804e-b1af45f11d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:24.742618 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2199c58-95b7-44ec-804e-b1af45f11d0a service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:24.752781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1237/2471] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:26:25.122441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a33ba-3082-498b-bdd3-4f23f021e275 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:25.122922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a33ba-3082-498b-bdd3-4f23f021e275 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:25.123002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a33ba-3082-498b-bdd3-4f23f021e275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:25.142250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6f6a33ba-3082-498b-bdd3-4f23f021e275 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:25.143449 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6f6a33ba-3082-498b-bdd3-4f23f021e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:25.207765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1235/2472] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 9 12:26:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:25.284242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2199c58-95b7-44ec-804e-b1af45f11d0a service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:25.286039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b2199c58-95b7-44ec-804e-b1af45f11d0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:25.382081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2199c58-95b7-44ec-804e-b1af45f11d0a service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:25.387675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ca296-070a-4beb-b6ae-9b0ee6d6c566 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:25.388710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ca296-070a-4beb-b6ae-9b0ee6d6c566 service swift] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:25.388979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ca296-070a-4beb-b6ae-9b0ee6d6c566 service swift] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:25.389244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ca296-070a-4beb-b6ae-9b0ee6d6c566 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:25.404079 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ca296-070a-4beb-b6ae-9b0ee6d6c566 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:25.407343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ca296-070a-4beb-b6ae-9b0ee6d6c566 service swift] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:25.421199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1238/2473] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:26:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:26:33.203585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a33ba-3082-498b-bdd3-4f23f021e275 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:33.205184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6f6a33ba-3082-498b-bdd3-4f23f021e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:33.277501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a33ba-3082-498b-bdd3-4f23f021e275 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:33.282496 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:33.283162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:33.283608 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:33.283880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] PATH_INFO: `/v3/users/a14a743ee4924fc5855c0278df7ca5e8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:33.285205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14a743ee4924fc5855c0278df7ca5e8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:33.287544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:33.344961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14a743ee4924fc5855c0278df7ca5e8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.352821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14a743ee4924fc5855c0278df7ca5e8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.353733 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14a743ee4924fc5855c0278df7ca5e8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.354501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14a743ee4924fc5855c0278df7ca5e8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.363649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14a743ee4924fc5855c0278df7ca5e8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.386967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1236/2474] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:26:33 2022] DELETE /identity/v3/users/a14a743ee4924fc5855c0278df7ca5e8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:33.567288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ca296-070a-4beb-b6ae-9b0ee6d6c566 service swift] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:33.579651 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ca296-070a-4beb-b6ae-9b0ee6d6c566 service swift] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:33.637911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:33.638536 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:33.638809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:33.639081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] PATH_INFO: `/v3/projects/fd5a1ee88149444db094adf93e8c1ad6` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:33.640168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5a1ee88149444db094adf93e8c1ad6)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:33.642096 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:33.680299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:33.690809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5a1ee88149444db094adf93e8c1ad6', 'request_id': 'req-3bcd3221-7376-4998-842b-340c5f0ffaa2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.696561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5a1ee88149444db094adf93e8c1ad6', 'request_id': 'req-3bcd3221-7376-4998-842b-340c5f0ffaa2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.703477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5a1ee88149444db094adf93e8c1ad6', 'request_id': 'req-3bcd3221-7376-4998-842b-340c5f0ffaa2'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.714503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] The token cache is being invalidate because project fd5a1ee88149444db094adf93e8c1ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:26:33.714800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.715412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.716895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1239/2475] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:26:33 2022] DELETE /identity/v3/projects/fd5a1ee88149444db094adf93e8c1ad6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:33.720918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:33.722416 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:33.735989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff3130-1954-467b-8f81-e42f7d9e09f5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:33.755918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:33.793475 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:33.794097 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:33.794371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:33.794638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] PATH_INFO: `/v3/users/04243556b5c0420187228f085d847cef` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:33.796023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=04243556b5c0420187228f085d847cef)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:33.797950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:33.844561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04243556b5c0420187228f085d847cef'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.851549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04243556b5c0420187228f085d847cef'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.852219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04243556b5c0420187228f085d847cef'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.852843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04243556b5c0420187228f085d847cef'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.860041 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04243556b5c0420187228f085d847cef'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:33.876967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1237/2476] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:26:33 2022] DELETE /identity/v3/users/04243556b5c0420187228f085d847cef => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:34.049944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:34.051605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:34.065619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd3221-7376-4998-842b-340c5f0ffaa2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:34.124520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:34.125183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:34.125456 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:34.125742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] PATH_INFO: `/v3/projects/75a98f5cebc34159a26b022ff7a68960` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:34.126834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a98f5cebc34159a26b022ff7a68960)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:34.128823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:34.153815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:34.155276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:34.176350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a98f5cebc34159a26b022ff7a68960', 'request_id': 'req-ebec7bb2-adb9-4917-9606-530c65e45aae'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:34.183202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a98f5cebc34159a26b022ff7a68960', 'request_id': 'req-ebec7bb2-adb9-4917-9606-530c65e45aae'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:34.190998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a98f5cebc34159a26b022ff7a68960', 'request_id': 'req-ebec7bb2-adb9-4917-9606-530c65e45aae'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:34.204011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] The token cache is being invalidate because project 75a98f5cebc34159a26b022ff7a68960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:26:34.204281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:34.204968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:34.206490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1240/2477] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:26:34 2022] DELETE /identity/v3/projects/75a98f5cebc34159a26b022ff7a68960 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:34.220250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb2e2a-4cf4-48cf-af49-9ff31bccc28b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:34.279589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a9b86-4bcb-4c48-927e-c3ece90bf1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:34.280216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a9b86-4bcb-4c48-927e-c3ece90bf1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:34.280492 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a9b86-4bcb-4c48-927e-c3ece90bf1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:34.280856 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a9b86-4bcb-4c48-927e-c3ece90bf1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:34.282922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3c2a9b86-4bcb-4c48-927e-c3ece90bf1a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:34.297713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:34.370977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a9b86-4bcb-4c48-927e-c3ece90bf1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:34.372641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a9b86-4bcb-4c48-927e-c3ece90bf1a3 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:34.386216 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1238/2478] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:26:35.570429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:35.571881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:35.584066 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec7bb2-adb9-4917-9606-530c65e45aae admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:35.587645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20d91c-3cdb-477e-8445-4008bf6ed06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:35.588234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d91c-3cdb-477e-8445-4008bf6ed06c service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:35.588510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d91c-3cdb-477e-8445-4008bf6ed06c service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:35.588816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d91c-3cdb-477e-8445-4008bf6ed06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:35.590478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-de20d91c-3cdb-477e-8445-4008bf6ed06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:35.603596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20d91c-3cdb-477e-8445-4008bf6ed06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:35.605062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20d91c-3cdb-477e-8445-4008bf6ed06c service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:35.616330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1241/2479] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:26:37.963903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a9b86-4bcb-4c48-927e-c3ece90bf1a3 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:37.972354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a9b86-4bcb-4c48-927e-c3ece90bf1a3 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:37.976800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feae3b-6fd5-4a22-95e9-062d217c7a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:37.977393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feae3b-6fd5-4a22-95e9-062d217c7a6c service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:37.977668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feae3b-6fd5-4a22-95e9-062d217c7a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:37.977934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feae3b-6fd5-4a22-95e9-062d217c7a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:37.979621 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-80feae3b-6fd5-4a22-95e9-062d217c7a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:38.041365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80feae3b-6fd5-4a22-95e9-062d217c7a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:38.042698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80feae3b-6fd5-4a22-95e9-062d217c7a6c service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:38.052382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1239/2480] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:26:40.947682 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20d91c-3cdb-477e-8445-4008bf6ed06c service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:40.949578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-de20d91c-3cdb-477e-8445-4008bf6ed06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:40.968569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20d91c-3cdb-477e-8445-4008bf6ed06c service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:40.975692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:40.976324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:40.976602 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:40.976910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] PATH_INFO: `/v3/users/7a22b52fdd5b46229d7306086ae11738` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:40.978040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a22b52fdd5b46229d7306086ae11738)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:40.980009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:41.016448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:41.028049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a22b52fdd5b46229d7306086ae11738'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:41.035501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a22b52fdd5b46229d7306086ae11738'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:41.036114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a22b52fdd5b46229d7306086ae11738'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:41.036831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a22b52fdd5b46229d7306086ae11738'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:41.044479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-eeda6f41-fe64-452e-83fc-e3ce1b58b3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a22b52fdd5b46229d7306086ae11738'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:41.061732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1242/2481] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:26:40 2022] DELETE /identity/v3/users/7a22b52fdd5b46229d7306086ae11738 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:41.240114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feae3b-6fd5-4a22-95e9-062d217c7a6c service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:41.251349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feae3b-6fd5-4a22-95e9-062d217c7a6c service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:41.325909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:41.326730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:41.327105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:41.327280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] PATH_INFO: `/v3/projects/58874b18c9be4155a7cdff000a132bc4` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:41.329966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58874b18c9be4155a7cdff000a132bc4)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:41.332182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:41.383003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:41.405715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58874b18c9be4155a7cdff000a132bc4', 'request_id': 'req-5fc31c6b-bdec-4e33-b078-12860f607c31'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:41.412708 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58874b18c9be4155a7cdff000a132bc4', 'request_id': 'req-5fc31c6b-bdec-4e33-b078-12860f607c31'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:41.422692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58874b18c9be4155a7cdff000a132bc4', 'request_id': 'req-5fc31c6b-bdec-4e33-b078-12860f607c31'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:41.436394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] The token cache is being invalidate because project 58874b18c9be4155a7cdff000a132bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:26:41.436716 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:41.437351 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5fc31c6b-bdec-4e33-b078-12860f607c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:41.438830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1240/2482] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:26:41 2022] DELETE /identity/v3/projects/58874b18c9be4155a7cdff000a132bc4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:41.444432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d52e8-9014-4606-8442-c19503bef922 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:41.444748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d52e8-9014-4606-8442-c19503bef922 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:41.445030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d52e8-9014-4606-8442-c19503bef922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:41.465360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-2f9d52e8-9014-4606-8442-c19503bef922 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:41.466565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-2f9d52e8-9014-4606-8442-c19503bef922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:41.525863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1243/2483] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:41.533664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c392-7a64-47fb-8272-e7b1e7411e32 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:41.533944 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c392-7a64-47fb-8272-e7b1e7411e32 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:41.534212 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c392-7a64-47fb-8272-e7b1e7411e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:41.554604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f607c392-7a64-47fb-8272-e7b1e7411e32 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:41.555801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f607c392-7a64-47fb-8272-e7b1e7411e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:41.563654 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1241/2484] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:41.568660 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d52e8-9014-4606-8442-c19503bef922 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:41.578748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d52e8-9014-4606-8442-c19503bef922 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:41.583419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54eef0-8c80-450a-9b91-e1ff7e8ea1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:41.584063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54eef0-8c80-450a-9b91-e1ff7e8ea1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:41.584336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54eef0-8c80-450a-9b91-e1ff7e8ea1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:41.584606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54eef0-8c80-450a-9b91-e1ff7e8ea1bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:41.585270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54eef0-8c80-450a-9b91-e1ff7e8ea1bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:26:41.585571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54eef0-8c80-450a-9b91-e1ff7e8ea1bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:41.587244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54eef0-8c80-450a-9b91-e1ff7e8ea1bc admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:41.598633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1244/2485] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:26:41.603065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c392-7a64-47fb-8272-e7b1e7411e32 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:41.612327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c392-7a64-47fb-8272-e7b1e7411e32 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:41.617467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21201a-b45b-4304-9d80-9c3582a898bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:41.618055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21201a-b45b-4304-9d80-9c3582a898bb admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:41.618333 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21201a-b45b-4304-9d80-9c3582a898bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:41.618603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21201a-b45b-4304-9d80-9c3582a898bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:41.619228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21201a-b45b-4304-9d80-9c3582a898bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:41.621148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21201a-b45b-4304-9d80-9c3582a898bb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:41.649076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1242/2486] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:26:41 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:26:41.653190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54eef0-8c80-450a-9b91-e1ff7e8ea1bc admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:41.663588 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54eef0-8c80-450a-9b91-e1ff7e8ea1bc admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:41.720752 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b16fd-70d5-4d76-b06d-ee4cd1129ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:41.721270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b16fd-70d5-4d76-b06d-ee4cd1129ace admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:41.721546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b16fd-70d5-4d76-b06d-ee4cd1129ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:41.721810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b16fd-70d5-4d76-b06d-ee4cd1129ace admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:41.722429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b16fd-70d5-4d76-b06d-ee4cd1129ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:41.724389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b16fd-70d5-4d76-b06d-ee4cd1129ace admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:41.752018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1245/2487] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:26:41 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:26:41.753388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21201a-b45b-4304-9d80-9c3582a898bb admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:41.764276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21201a-b45b-4304-9d80-9c3582a898bb admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:41.768862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35dc66-1771-4631-baab-91ef5f857ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:41.769453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35dc66-1771-4631-baab-91ef5f857ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:41.769727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35dc66-1771-4631-baab-91ef5f857ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:41.769991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35dc66-1771-4631-baab-91ef5f857ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:41.770618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35dc66-1771-4631-baab-91ef5f857ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:41.772193 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35dc66-1771-4631-baab-91ef5f857ad5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:41.782034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1243/2488] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:26:41.785846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b16fd-70d5-4d76-b06d-ee4cd1129ace admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:41.796000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b16fd-70d5-4d76-b06d-ee4cd1129ace admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:41.801058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cf01e-c9e6-4037-b7af-b7fab3b77c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:41.801639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cf01e-c9e6-4037-b7af-b7fab3b77c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:41.801915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cf01e-c9e6-4037-b7af-b7fab3b77c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:41.802697 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cf01e-c9e6-4037-b7af-b7fab3b77c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:41.803449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cf01e-c9e6-4037-b7af-b7fab3b77c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:41.805063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cf01e-c9e6-4037-b7af-b7fab3b77c16 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:41.815752 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1246/2489] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:26:41.820382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35dc66-1771-4631-baab-91ef5f857ad5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:41.830278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35dc66-1771-4631-baab-91ef5f857ad5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:41.835077 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ec7a6-5612-4f0c-85bd-b1c572a1bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:41.835818 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ec7a6-5612-4f0c-85bd-b1c572a1bd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:41.836101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ec7a6-5612-4f0c-85bd-b1c572a1bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:41.836399 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ec7a6-5612-4f0c-85bd-b1c572a1bd41 admin admin] PATH_INFO: `/v3/projects/091626d622d543df88c2042d76f16529/users/829300ee1bbe4dddb264eca8cf7c2df8/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:41.850985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ec7a6-5612-4f0c-85bd-b1c572a1bd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091626d622d543df88c2042d76f16529, user_id=829300ee1bbe4dddb264eca8cf7c2df8, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:41.853650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ec7a6-5612-4f0c-85bd-b1c572a1bd41 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:41.867103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1244/2490] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:26:41 2022] PUT /identity/v3/projects/091626d622d543df88c2042d76f16529/users/829300ee1bbe4dddb264eca8cf7c2df8/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:41.872315 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1db35-e096-4262-9978-7c67d175815a None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:41.872594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1db35-e096-4262-9978-7c67d175815a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:41.872894 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1db35-e096-4262-9978-7c67d175815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:41.891952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-98f1db35-e096-4262-9978-7c67d175815a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:41.893176 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-98f1db35-e096-4262-9978-7c67d175815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:41.904904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:41.955104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1247/2491] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:41.964904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ec7a6-5612-4f0c-85bd-b1c572a1bd41 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:41.966658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-495ec7a6-5612-4f0c-85bd-b1c572a1bd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:42.022372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ec7a6-5612-4f0c-85bd-b1c572a1bd41 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:42.025884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c6219-fb61-4138-b996-f3520b187c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:42.026471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c6219-fb61-4138-b996-f3520b187c7e service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:42.026744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c6219-fb61-4138-b996-f3520b187c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:42.027031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c6219-fb61-4138-b996-f3520b187c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:42.035644 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c6219-fb61-4138-b996-f3520b187c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:42.037686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c6219-fb61-4138-b996-f3520b187c7e service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:42.046820 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1245/2492] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:26:46.004145 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b4c8-4476-4919-8910-094a89132511 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:46.004725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b4c8-4476-4919-8910-094a89132511 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:46.004725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b4c8-4476-4919-8910-094a89132511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:46.039478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d9b9b4c8-4476-4919-8910-094a89132511 None None] MFA Rules not processed for user `829300ee1bbe4dddb264eca8cf7c2df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:46.041036 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d9b9b4c8-4476-4919-8910-094a89132511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:46.120498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1248/2493] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:26:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:46.128214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c6219-fb61-4138-b996-f3520b187c7e service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:46.129664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-399c6219-fb61-4138-b996-f3520b187c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:46.219582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:46.226745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c6219-fb61-4138-b996-f3520b187c7e service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:46.232931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9e31-4efc-4b8c-8440-086536bf1cfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:46.233546 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9e31-4efc-4b8c-8440-086536bf1cfe service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:46.233812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9e31-4efc-4b8c-8440-086536bf1cfe service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:46.234080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9e31-4efc-4b8c-8440-086536bf1cfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:46.245934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a9e31-4efc-4b8c-8440-086536bf1cfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:46.247647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a9e31-4efc-4b8c-8440-086536bf1cfe service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:46.258903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1246/2494] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:26:47.633721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00327fe7-8db4-4af7-af26-c1260424bb52 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:47.634263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00327fe7-8db4-4af7-af26-c1260424bb52 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:47.634381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00327fe7-8db4-4af7-af26-c1260424bb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:47.654031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-00327fe7-8db4-4af7-af26-c1260424bb52 None None] MFA Rules not processed for user `829300ee1bbe4dddb264eca8cf7c2df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:47.655268 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-00327fe7-8db4-4af7-af26-c1260424bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:47.662348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1249/2495] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:26:47.989157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9e31-4efc-4b8c-8440-086536bf1cfe service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:47.991298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1c5a9e31-4efc-4b8c-8440-086536bf1cfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:48.004018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9e31-4efc-4b8c-8440-086536bf1cfe service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:48.007940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d4891-80ac-4f28-935f-457c698ddc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:48.008537 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4891-80ac-4f28-935f-457c698ddc09 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:48.008839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4891-80ac-4f28-935f-457c698ddc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:48.009108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4891-80ac-4f28-935f-457c698ddc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:48.010812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7a2d4891-80ac-4f28-935f-457c698ddc09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:48.020815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d4891-80ac-4f28-935f-457c698ddc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:48.022447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d4891-80ac-4f28-935f-457c698ddc09 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:48.030897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1247/2496] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:26:57.648249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=54 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:58.027013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=11 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:58.980575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00327fe7-8db4-4af7-af26-c1260424bb52 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:58.991468 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00327fe7-8db4-4af7-af26-c1260424bb52 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:58.995218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3b7db-739c-408b-a497-2d64c450c055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:58.996065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3b7db-739c-408b-a497-2d64c450c055 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:58.996065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3b7db-739c-408b-a497-2d64c450c055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:58.996357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3b7db-739c-408b-a497-2d64c450c055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:58.998173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c0a3b7db-739c-408b-a497-2d64c450c055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:59.016877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3b7db-739c-408b-a497-2d64c450c055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:59.016877 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3b7db-739c-408b-a497-2d64c450c055 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:59.020502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1250/2497] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:02.005946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d4891-80ac-4f28-935f-457c698ddc09 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:02.007392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7a2d4891-80ac-4f28-935f-457c698ddc09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:02.023511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d4891-80ac-4f28-935f-457c698ddc09 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:02.028931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45a1fb-1587-485a-a9f7-17263c47854e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:02.029517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45a1fb-1587-485a-a9f7-17263c47854e service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:02.029788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45a1fb-1587-485a-a9f7-17263c47854e service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:02.030050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45a1fb-1587-485a-a9f7-17263c47854e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:02.031699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5e45a1fb-1587-485a-a9f7-17263c47854e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:02.096014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45a1fb-1587-485a-a9f7-17263c47854e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:02.097783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45a1fb-1587-485a-a9f7-17263c47854e service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:02.107533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1248/2498] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:09.016131 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=6 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:09.029994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3b7db-739c-408b-a497-2d64c450c055 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:09.045064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3b7db-739c-408b-a497-2d64c450c055 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:09.052642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78318f9-fbfe-413c-aad2-29d01d7b4a14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:09.053297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78318f9-fbfe-413c-aad2-29d01d7b4a14 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:09.053578 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78318f9-fbfe-413c-aad2-29d01d7b4a14 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:09.053846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78318f9-fbfe-413c-aad2-29d01d7b4a14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:09.055580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e78318f9-fbfe-413c-aad2-29d01d7b4a14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:09.069430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78318f9-fbfe-413c-aad2-29d01d7b4a14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:09.071258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78318f9-fbfe-413c-aad2-29d01d7b4a14 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:09.090086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1251/2499] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:12.103503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=28 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:14.271614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45a1fb-1587-485a-a9f7-17263c47854e service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:14.280805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45a1fb-1587-485a-a9f7-17263c47854e service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:14.284435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c1d8e-c45d-483d-b8f9-ce160f74e469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:14.285143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c1d8e-c45d-483d-b8f9-ce160f74e469 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:14.285488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c1d8e-c45d-483d-b8f9-ce160f74e469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:14.285826 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c1d8e-c45d-483d-b8f9-ce160f74e469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:14.287718 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7d3c1d8e-c45d-483d-b8f9-ce160f74e469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:14.300398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c1d8e-c45d-483d-b8f9-ce160f74e469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:14.301948 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c1d8e-c45d-483d-b8f9-ce160f74e469 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:14.312717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1249/2500] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:17.058173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25686770-ccf2-4f3c-9612-bba3d384f06e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:17.058705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25686770-ccf2-4f3c-9612-bba3d384f06e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:17.058874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25686770-ccf2-4f3c-9612-bba3d384f06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:17.079312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-25686770-ccf2-4f3c-9612-bba3d384f06e None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:17.080597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-25686770-ccf2-4f3c-9612-bba3d384f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:17.160107 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1252/2501] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:27:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:27:17.173549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c1d8e-c45d-483d-b8f9-ce160f74e469 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:17.175026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7d3c1d8e-c45d-483d-b8f9-ce160f74e469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:17.274115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c1d8e-c45d-483d-b8f9-ce160f74e469 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:17.283063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59baa2-1d5a-4450-a37f-8e6248285c37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:17.284862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59baa2-1d5a-4450-a37f-8e6248285c37 service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:17.285256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59baa2-1d5a-4450-a37f-8e6248285c37 service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:17.285751 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59baa2-1d5a-4450-a37f-8e6248285c37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:17.299691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59baa2-1d5a-4450-a37f-8e6248285c37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:17.301750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59baa2-1d5a-4450-a37f-8e6248285c37 service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:17.324749 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1250/2502] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:27:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:27:17.754390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25686770-ccf2-4f3c-9612-bba3d384f06e None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:17.755847 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-25686770-ccf2-4f3c-9612-bba3d384f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:17.787764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25686770-ccf2-4f3c-9612-bba3d384f06e None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:17.793852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:17.794930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:17.795418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:17.795953 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] PATH_INFO: `/v3/users/fcedc1966e19490fb739046a3379b135` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:17.798002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcedc1966e19490fb739046a3379b135)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:17.800508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:17.853892 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59baa2-1d5a-4450-a37f-8e6248285c37 service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:17.874092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59baa2-1d5a-4450-a37f-8e6248285c37 service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:17.878988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcedc1966e19490fb739046a3379b135'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:17.880720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdf0c6-eefa-45e4-9cd9-6cfd71b91fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:17.882112 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdf0c6-eefa-45e4-9cd9-6cfd71b91fb0 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:17.882545 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdf0c6-eefa-45e4-9cd9-6cfd71b91fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:17.882972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdf0c6-eefa-45e4-9cd9-6cfd71b91fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:17.884961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f7cdf0c6-eefa-45e4-9cd9-6cfd71b91fb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:17.901615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdf0c6-eefa-45e4-9cd9-6cfd71b91fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:17.903440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdf0c6-eefa-45e4-9cd9-6cfd71b91fb0 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:17.906332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcedc1966e19490fb739046a3379b135'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:17.908087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcedc1966e19490fb739046a3379b135'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:17.909831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcedc1966e19490fb739046a3379b135'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:17.923694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1251/2503] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:27:17.940713 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-a203d554-5957-45ba-a02c-573c639b0c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcedc1966e19490fb739046a3379b135'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:17.986408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1253/2504] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:17 2022] DELETE /identity/v3/users/fcedc1966e19490fb739046a3379b135 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:18.264256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdf0c6-eefa-45e4-9cd9-6cfd71b91fb0 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:18.294298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdf0c6-eefa-45e4-9cd9-6cfd71b91fb0 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:18.371332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:18.372242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:18.372711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:18.373135 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] PATH_INFO: `/v3/projects/51d5996d1e77474e9468e1316c838830` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:18.376201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d5996d1e77474e9468e1316c838830)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:18.378186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:18.455692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d5996d1e77474e9468e1316c838830', 'request_id': 'req-f1209145-aaeb-4822-9072-eeb77070f7d7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:18.462409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d5996d1e77474e9468e1316c838830', 'request_id': 'req-f1209145-aaeb-4822-9072-eeb77070f7d7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:18.473917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d5996d1e77474e9468e1316c838830', 'request_id': 'req-f1209145-aaeb-4822-9072-eeb77070f7d7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:18.475368 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:18.494469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] The token cache is being invalidate because project 51d5996d1e77474e9468e1316c838830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:18.494765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:18.495413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f1209145-aaeb-4822-9072-eeb77070f7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:18.497283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1252/2505] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:18 2022] DELETE /identity/v3/projects/51d5996d1e77474e9468e1316c838830 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:18.501903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0836b33-2bdb-4d2e-b7c1-2da75e0d56ed None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:18.502385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0836b33-2bdb-4d2e-b7c1-2da75e0d56ed None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:18.502586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0836b33-2bdb-4d2e-b7c1-2da75e0d56ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:18.527830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c0836b33-2bdb-4d2e-b7c1-2da75e0d56ed None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:18.529839 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c0836b33-2bdb-4d2e-b7c1-2da75e0d56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:18.607379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1254/2506] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:18.618081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea98c69-15cd-4010-9c25-ddc13ce9081e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:18.618382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea98c69-15cd-4010-9c25-ddc13ce9081e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:18.618651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea98c69-15cd-4010-9c25-ddc13ce9081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:18.641459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5ea98c69-15cd-4010-9c25-ddc13ce9081e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:18.642662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5ea98c69-15cd-4010-9c25-ddc13ce9081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:18.650755 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1253/2507] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:27:18.656466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0836b33-2bdb-4d2e-b7c1-2da75e0d56ed None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:18.664052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:18.667722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0836b33-2bdb-4d2e-b7c1-2da75e0d56ed None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:18.676558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665b286-13c3-48b7-bc24-a2fd09676a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:18.677225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665b286-13c3-48b7-bc24-a2fd09676a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:18.677519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665b286-13c3-48b7-bc24-a2fd09676a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:18.677785 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665b286-13c3-48b7-bc24-a2fd09676a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:18.678968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665b286-13c3-48b7-bc24-a2fd09676a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:27:18.679386 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665b286-13c3-48b7-bc24-a2fd09676a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:18.681021 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665b286-13c3-48b7-bc24-a2fd09676a23 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:18.693434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1255/2508] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:27:18.699329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea98c69-15cd-4010-9c25-ddc13ce9081e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:18.712656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea98c69-15cd-4010-9c25-ddc13ce9081e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:18.718888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6316a-bfd6-4239-8e67-3efab03433c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:18.718888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6316a-bfd6-4239-8e67-3efab03433c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:18.718888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6316a-bfd6-4239-8e67-3efab03433c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:18.718888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6316a-bfd6-4239-8e67-3efab03433c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:18.719772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6316a-bfd6-4239-8e67-3efab03433c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:18.721082 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6316a-bfd6-4239-8e67-3efab03433c2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:18.753659 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1254/2509] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:18 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:27:18.758106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665b286-13c3-48b7-bc24-a2fd09676a23 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:18.770819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665b286-13c3-48b7-bc24-a2fd09676a23 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:18.839848 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33f3c-ad61-40c1-8bec-afbbce17b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:18.840446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33f3c-ad61-40c1-8bec-afbbce17b839 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:18.840778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33f3c-ad61-40c1-8bec-afbbce17b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:18.841046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33f3c-ad61-40c1-8bec-afbbce17b839 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:18.841665 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f33f3c-ad61-40c1-8bec-afbbce17b839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:18.843908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f33f3c-ad61-40c1-8bec-afbbce17b839 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:18.871323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1256/2510] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:18 2022] POST /identity/v3/users => generated 303 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:27:18.875203 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6316a-bfd6-4239-8e67-3efab03433c2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:18.887032 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6316a-bfd6-4239-8e67-3efab03433c2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:18.892522 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2b874-0099-4dd5-abe2-b9b33ed9589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:18.893247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2b874-0099-4dd5-abe2-b9b33ed9589f admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:18.893597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2b874-0099-4dd5-abe2-b9b33ed9589f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:18.893937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2b874-0099-4dd5-abe2-b9b33ed9589f admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:18.894650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2b874-0099-4dd5-abe2-b9b33ed9589f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:18.896438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2b874-0099-4dd5-abe2-b9b33ed9589f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:18.908669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1255/2511] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:27:18.914659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33f3c-ad61-40c1-8bec-afbbce17b839 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:18.925990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33f3c-ad61-40c1-8bec-afbbce17b839 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:18.930954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080fb9e-35da-4ce8-a4b0-70b004dda678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:18.931646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080fb9e-35da-4ce8-a4b0-70b004dda678 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:18.931989 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080fb9e-35da-4ce8-a4b0-70b004dda678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:18.932322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080fb9e-35da-4ce8-a4b0-70b004dda678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:18.933078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080fb9e-35da-4ce8-a4b0-70b004dda678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:18.934746 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080fb9e-35da-4ce8-a4b0-70b004dda678 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:18.946937 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1257/2512] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:18.951371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2b874-0099-4dd5-abe2-b9b33ed9589f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:18.962501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2b874-0099-4dd5-abe2-b9b33ed9589f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:18.968177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65961d59-4db6-404f-a2bd-2b548c2949ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:18.969124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65961d59-4db6-404f-a2bd-2b548c2949ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:18.969566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65961d59-4db6-404f-a2bd-2b548c2949ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:18.970661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65961d59-4db6-404f-a2bd-2b548c2949ee admin admin] PATH_INFO: `/v3/projects/01bba85fe48e422682c40c871c7a80d9/users/8fd46fcdbdc5440d830d74f053908924/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:18.987763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65961d59-4db6-404f-a2bd-2b548c2949ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bba85fe48e422682c40c871c7a80d9, user_id=8fd46fcdbdc5440d830d74f053908924, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:18.990445 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65961d59-4db6-404f-a2bd-2b548c2949ee admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:19.008175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1256/2513] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:18 2022] PUT /identity/v3/projects/01bba85fe48e422682c40c871c7a80d9/users/8fd46fcdbdc5440d830d74f053908924/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:19.021177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b3ed9-0040-4b1d-836b-da8c00625fc8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:19.021716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b3ed9-0040-4b1d-836b-da8c00625fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:19.022696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b3ed9-0040-4b1d-836b-da8c00625fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:19.058401 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c64b3ed9-0040-4b1d-836b-da8c00625fc8 None None] MFA Rules not processed for user `8fd46fcdbdc5440d830d74f053908924`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:19.059760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c64b3ed9-0040-4b1d-836b-da8c00625fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:19.137334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1258/2514] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:19.141665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65961d59-4db6-404f-a2bd-2b548c2949ee admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:19.222361 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65961d59-4db6-404f-a2bd-2b548c2949ee admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:19.232887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562773d8-8644-46be-b6f0-00800db166f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:19.234002 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562773d8-8644-46be-b6f0-00800db166f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:19.234600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562773d8-8644-46be-b6f0-00800db166f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:19.235060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562773d8-8644-46be-b6f0-00800db166f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:19.235875 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562773d8-8644-46be-b6f0-00800db166f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:19.238932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562773d8-8644-46be-b6f0-00800db166f3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:19.283422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1257/2515] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:19 2022] POST /identity/v3/projects => generated 405 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:19.287567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b3ed9-0040-4b1d-836b-da8c00625fc8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:19.301111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b3ed9-0040-4b1d-836b-da8c00625fc8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:19.376361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b1f37-5d19-4096-b462-06db9958a443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:19.377021 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b1f37-5d19-4096-b462-06db9958a443 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:19.377300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b1f37-5d19-4096-b462-06db9958a443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:19.377569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b1f37-5d19-4096-b462-06db9958a443 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:19.378189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b1f37-5d19-4096-b462-06db9958a443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:19.380871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b1f37-5d19-4096-b462-06db9958a443 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:19.390331 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:19.416442 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1259/2516] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:19 2022] POST /identity/v3/users => generated 309 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:27:19.426263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562773d8-8644-46be-b6f0-00800db166f3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:19.439574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562773d8-8644-46be-b6f0-00800db166f3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:19.448235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e0601-23dd-4142-991f-420c5d76d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:19.449029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e0601-23dd-4142-991f-420c5d76d2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:19.449309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e0601-23dd-4142-991f-420c5d76d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:19.449577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e0601-23dd-4142-991f-420c5d76d2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:19.450294 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e0601-23dd-4142-991f-420c5d76d2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:19.452047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e0601-23dd-4142-991f-420c5d76d2d4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:19.465308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1258/2517] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:19.469675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b1f37-5d19-4096-b462-06db9958a443 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:19.482820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b1f37-5d19-4096-b462-06db9958a443 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:19.488841 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227db5-444e-47b9-bb10-c9af0069a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:19.489498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227db5-444e-47b9-bb10-c9af0069a053 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:19.489778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227db5-444e-47b9-bb10-c9af0069a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:19.490045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227db5-444e-47b9-bb10-c9af0069a053 admin admin] PATH_INFO: `/v3/projects/e10a7d99b1da4bdb8dda3c93f36a7248/users/1f6d3ebd7eb74e7385d960f88bfe2c1b/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:19.511761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227db5-444e-47b9-bb10-c9af0069a053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10a7d99b1da4bdb8dda3c93f36a7248, user_id=1f6d3ebd7eb74e7385d960f88bfe2c1b, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:19.514653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227db5-444e-47b9-bb10-c9af0069a053 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:19.532276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1260/2518] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:19 2022] PUT /identity/v3/projects/e10a7d99b1da4bdb8dda3c93f36a7248/users/1f6d3ebd7eb74e7385d960f88bfe2c1b/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:19.536144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e0601-23dd-4142-991f-420c5d76d2d4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:19.548432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e0601-23dd-4142-991f-420c5d76d2d4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:19.621012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21eab1a-691f-4ac2-9ee8-bac0d0694b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:19.622107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eab1a-691f-4ac2-9ee8-bac0d0694b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:19.622412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eab1a-691f-4ac2-9ee8-bac0d0694b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:19.622778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eab1a-691f-4ac2-9ee8-bac0d0694b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:19.623417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21eab1a-691f-4ac2-9ee8-bac0d0694b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:19.625375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21eab1a-691f-4ac2-9ee8-bac0d0694b2a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:19.631067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:19.644803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1259/2519] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:19.646829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227db5-444e-47b9-bb10-c9af0069a053 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:19.659281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227db5-444e-47b9-bb10-c9af0069a053 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:19.664150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6681901-7581-4e54-861b-416683718fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:19.664852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6681901-7581-4e54-861b-416683718fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:19.665132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6681901-7581-4e54-861b-416683718fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:19.665402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6681901-7581-4e54-861b-416683718fe3 admin admin] PATH_INFO: `/v3/projects/e10a7d99b1da4bdb8dda3c93f36a7248/users/1f6d3ebd7eb74e7385d960f88bfe2c1b/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:19.667322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6681901-7581-4e54-861b-416683718fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10a7d99b1da4bdb8dda3c93f36a7248, user_id=1f6d3ebd7eb74e7385d960f88bfe2c1b, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:19.670005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6681901-7581-4e54-861b-416683718fe3 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:19.683945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1261/2520] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:19 2022] PUT /identity/v3/projects/e10a7d99b1da4bdb8dda3c93f36a7248/users/1f6d3ebd7eb74e7385d960f88bfe2c1b/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:19.696439 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82be7-584a-47da-bc69-a0f6f1f0ccb0 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:19.697031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82be7-584a-47da-bc69-a0f6f1f0ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:19.697424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82be7-584a-47da-bc69-a0f6f1f0ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:19.734302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-42e82be7-584a-47da-bc69-a0f6f1f0ccb0 None None] MFA Rules not processed for user `1f6d3ebd7eb74e7385d960f88bfe2c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:19.735724 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-42e82be7-584a-47da-bc69-a0f6f1f0ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:19.822113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1260/2521] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:19 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:19.834746 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6681901-7581-4e54-861b-416683718fe3 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:19.836502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c6681901-7581-4e54-861b-416683718fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:19.911498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6681901-7581-4e54-861b-416683718fe3 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:19.917717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ee1d4-7aa8-45b6-8d8a-ecd202fd42e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:19.918562 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ee1d4-7aa8-45b6-8d8a-ecd202fd42e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:19.918897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ee1d4-7aa8-45b6-8d8a-ecd202fd42e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:19.919235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ee1d4-7aa8-45b6-8d8a-ecd202fd42e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:19.930279 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ee1d4-7aa8-45b6-8d8a-ecd202fd42e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:19.931770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ee1d4-7aa8-45b6-8d8a-ecd202fd42e8 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:19.944243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1262/2522] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:19 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:27:20.102645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e82be7-584a-47da-bc69-a0f6f1f0ccb0 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:20.187477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e82be7-584a-47da-bc69-a0f6f1f0ccb0 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:20.192759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:20.193488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:20.193779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:20.194863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] PATH_INFO: `/v3/users/8fd46fcdbdc5440d830d74f053908924` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:20.196151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd46fcdbdc5440d830d74f053908924)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:20.198133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:20.286893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd46fcdbdc5440d830d74f053908924'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:20.293984 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd46fcdbdc5440d830d74f053908924'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:20.294669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd46fcdbdc5440d830d74f053908924'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:20.295283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd46fcdbdc5440d830d74f053908924'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:20.306126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd46fcdbdc5440d830d74f053908924'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:20.328519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1261/2523] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:20 2022] DELETE /identity/v3/users/8fd46fcdbdc5440d830d74f053908924 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:20.332977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbe04-dcf4-4387-a924-72c9d9fc8661 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:20.333530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbe04-dcf4-4387-a924-72c9d9fc8661 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:20.333816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbe04-dcf4-4387-a924-72c9d9fc8661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:20.365044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-eb6bbe04-dcf4-4387-a924-72c9d9fc8661 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:20.366809 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-eb6bbe04-dcf4-4387-a924-72c9d9fc8661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:20.461440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1263/2524] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:27:20.467108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:20.468736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:20.476919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:20.565903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc81f5-f9eb-4fe1-a0ab-74244eaa1a94 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:20.570689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ae34-aacc-4616-a5af-9c1ed504eaf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:20.571447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ae34-aacc-4616-a5af-9c1ed504eaf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:20.571855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ae34-aacc-4616-a5af-9c1ed504eaf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:20.572261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ae34-aacc-4616-a5af-9c1ed504eaf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:20.586763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832ae34-aacc-4616-a5af-9c1ed504eaf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:20.588398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832ae34-aacc-4616-a5af-9c1ed504eaf5 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:20.605159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1262/2525] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:27:21.209013 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbe04-dcf4-4387-a924-72c9d9fc8661 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:21.210525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-eb6bbe04-dcf4-4387-a924-72c9d9fc8661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:21.227351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbe04-dcf4-4387-a924-72c9d9fc8661 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:21.235756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:21.236521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:21.236912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:21.237217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] PATH_INFO: `/v3/projects/01bba85fe48e422682c40c871c7a80d9` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:21.238595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bba85fe48e422682c40c871c7a80d9)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:21.241467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:21.296478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bba85fe48e422682c40c871c7a80d9', 'request_id': 'req-94b822c7-fe76-4be4-9454-e72245dbf3f6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:21.297775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:21.304321 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bba85fe48e422682c40c871c7a80d9', 'request_id': 'req-94b822c7-fe76-4be4-9454-e72245dbf3f6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:21.314936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bba85fe48e422682c40c871c7a80d9', 'request_id': 'req-94b822c7-fe76-4be4-9454-e72245dbf3f6'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:21.328117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] The token cache is being invalidate because project 01bba85fe48e422682c40c871c7a80d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:21.328418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:21.329097 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:21.332367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1264/2526] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:21 2022] DELETE /identity/v3/projects/01bba85fe48e422682c40c871c7a80d9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:21.337243 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ae34-aacc-4616-a5af-9c1ed504eaf5 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:21.347487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ae34-aacc-4616-a5af-9c1ed504eaf5 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:21.435541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:21.436180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:21.436456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:21.436760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] PATH_INFO: `/v3/users/1f6d3ebd7eb74e7385d960f88bfe2c1b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:21.437873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6d3ebd7eb74e7385d960f88bfe2c1b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:21.439769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:21.510935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6d3ebd7eb74e7385d960f88bfe2c1b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:21.521146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6d3ebd7eb74e7385d960f88bfe2c1b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:21.522174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6d3ebd7eb74e7385d960f88bfe2c1b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:21.523104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6d3ebd7eb74e7385d960f88bfe2c1b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:21.532665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5a5d4413-bee0-4432-bd20-83fc0466840b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6d3ebd7eb74e7385d960f88bfe2c1b'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:21.554202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1263/2527] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:21 2022] DELETE /identity/v3/users/1f6d3ebd7eb74e7385d960f88bfe2c1b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:21.898685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:21.900447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:21.948707 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b822c7-fe76-4be4-9454-e72245dbf3f6 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:22.016492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:22.017639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.017925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.018198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] PATH_INFO: `/v3/projects/e10a7d99b1da4bdb8dda3c93f36a7248` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.019342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10a7d99b1da4bdb8dda3c93f36a7248)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:22.021428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:22.080557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10a7d99b1da4bdb8dda3c93f36a7248', 'request_id': 'req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:22.089040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10a7d99b1da4bdb8dda3c93f36a7248', 'request_id': 'req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:22.097494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10a7d99b1da4bdb8dda3c93f36a7248', 'request_id': 'req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:22.111910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] The token cache is being invalidate because project e10a7d99b1da4bdb8dda3c93f36a7248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:22.112210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:22.112964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e5e5f969-1ca7-42f5-acec-51dd4b2b0889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:22.114801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1265/2528] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:21 2022] DELETE /identity/v3/projects/e10a7d99b1da4bdb8dda3c93f36a7248 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:22.119913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf5966-12a8-42df-9736-6c3e97423bf1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.120198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf5966-12a8-42df-9736-6c3e97423bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.120471 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf5966-12a8-42df-9736-6c3e97423bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.144915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3cbf5966-12a8-42df-9736-6c3e97423bf1 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:22.146470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3cbf5966-12a8-42df-9736-6c3e97423bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:22.169823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:22.245782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1264/2529] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:22.254711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a92a8-de8b-4682-966c-423d735fa66d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.255210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a92a8-de8b-4682-966c-423d735fa66d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.255389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a92a8-de8b-4682-966c-423d735fa66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.284596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-116a92a8-de8b-4682-966c-423d735fa66d None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:22.284596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-116a92a8-de8b-4682-966c-423d735fa66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:22.294049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1266/2530] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:22.298594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf5966-12a8-42df-9736-6c3e97423bf1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:22.309918 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf5966-12a8-42df-9736-6c3e97423bf1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:22.315163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c659faf-f973-429b-9cf0-9dc1bc94b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:22.315804 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c659faf-f973-429b-9cf0-9dc1bc94b075 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.316086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c659faf-f973-429b-9cf0-9dc1bc94b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.316354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c659faf-f973-429b-9cf0-9dc1bc94b075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.317050 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c659faf-f973-429b-9cf0-9dc1bc94b075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:27:22.317341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c659faf-f973-429b-9cf0-9dc1bc94b075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:22.319495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c659faf-f973-429b-9cf0-9dc1bc94b075 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:22.335547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1265/2531] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:27:22.336718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a92a8-de8b-4682-966c-423d735fa66d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:22.346624 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a92a8-de8b-4682-966c-423d735fa66d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:22.351991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04da63-2cb5-4321-a549-b988e80024f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:22.352605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04da63-2cb5-4321-a549-b988e80024f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.352926 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04da63-2cb5-4321-a549-b988e80024f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.353202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04da63-2cb5-4321-a549-b988e80024f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.353836 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04da63-2cb5-4321-a549-b988e80024f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:22.356004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04da63-2cb5-4321-a549-b988e80024f0 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:22.390390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1267/2532] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:22 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:22.394570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c659faf-f973-429b-9cf0-9dc1bc94b075 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:22.407198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c659faf-f973-429b-9cf0-9dc1bc94b075 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:22.477689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a5a4c-fec2-4b73-8f1e-afd1151472db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:22.478434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a5a4c-fec2-4b73-8f1e-afd1151472db admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.478779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a5a4c-fec2-4b73-8f1e-afd1151472db admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.479118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a5a4c-fec2-4b73-8f1e-afd1151472db admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.479812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a5a4c-fec2-4b73-8f1e-afd1151472db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:22.481891 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a5a4c-fec2-4b73-8f1e-afd1151472db admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:22.505371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1266/2533] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:22 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:22.509634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04da63-2cb5-4321-a549-b988e80024f0 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:22.522912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04da63-2cb5-4321-a549-b988e80024f0 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:22.528294 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d088e-d588-4502-a8f8-e0157e3cff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:22.529179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d088e-d588-4502-a8f8-e0157e3cff33 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.529462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d088e-d588-4502-a8f8-e0157e3cff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.529731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d088e-d588-4502-a8f8-e0157e3cff33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.530369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d088e-d588-4502-a8f8-e0157e3cff33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:22.532039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d088e-d588-4502-a8f8-e0157e3cff33 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:22.544567 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1268/2534] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:22.549374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a5a4c-fec2-4b73-8f1e-afd1151472db admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:22.567037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a5a4c-fec2-4b73-8f1e-afd1151472db admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:22.572974 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e6266-7ba4-4741-87a1-7c83d4bb7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:22.573670 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e6266-7ba4-4741-87a1-7c83d4bb7348 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.574452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e6266-7ba4-4741-87a1-7c83d4bb7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.574734 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e6266-7ba4-4741-87a1-7c83d4bb7348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.575382 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e6266-7ba4-4741-87a1-7c83d4bb7348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:22.577067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e6266-7ba4-4741-87a1-7c83d4bb7348 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:22.592668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1267/2535] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:27:22.595375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d088e-d588-4502-a8f8-e0157e3cff33 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:22.606761 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d088e-d588-4502-a8f8-e0157e3cff33 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:22.611695 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5e737-04b1-4c0b-977e-bf883326aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:22.612356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e737-04b1-4c0b-977e-bf883326aa89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.612663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e737-04b1-4c0b-977e-bf883326aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.612932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e737-04b1-4c0b-977e-bf883326aa89 admin admin] PATH_INFO: `/v3/projects/38e4b5c2a01b4ca2bd9d09c5a24db0d0/users/de6470ef296e40f882707ed30cf1c2de/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.630965 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5e737-04b1-4c0b-977e-bf883326aa89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e4b5c2a01b4ca2bd9d09c5a24db0d0, user_id=de6470ef296e40f882707ed30cf1c2de, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:22.633797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5e737-04b1-4c0b-977e-bf883326aa89 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:22.649995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1269/2536] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:22 2022] PUT /identity/v3/projects/38e4b5c2a01b4ca2bd9d09c5a24db0d0/users/de6470ef296e40f882707ed30cf1c2de/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:22.660159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78cb6a-49f6-43eb-b010-6856e445a80a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.660570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78cb6a-49f6-43eb-b010-6856e445a80a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.660946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78cb6a-49f6-43eb-b010-6856e445a80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.692244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-cb78cb6a-49f6-43eb-b010-6856e445a80a None None] MFA Rules not processed for user `de6470ef296e40f882707ed30cf1c2de`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:22.694525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cb78cb6a-49f6-43eb-b010-6856e445a80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:22.776759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1268/2537] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:22.780853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5e737-04b1-4c0b-977e-bf883326aa89 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:22.787034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:22.858061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5e737-04b1-4c0b-977e-bf883326aa89 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:22.863163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce3d0a-b63c-4b1d-95ab-c9b06386981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:22.863915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce3d0a-b63c-4b1d-95ab-c9b06386981c admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:22.864256 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce3d0a-b63c-4b1d-95ab-c9b06386981c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:22.864592 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce3d0a-b63c-4b1d-95ab-c9b06386981c admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:22.865349 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce3d0a-b63c-4b1d-95ab-c9b06386981c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:22.868670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce3d0a-b63c-4b1d-95ab-c9b06386981c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:22.900317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1270/2538] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:22 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:22.905022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78cb6a-49f6-43eb-b010-6856e445a80a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:22.916994 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78cb6a-49f6-43eb-b010-6856e445a80a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:22.942588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:23.001972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262b067-c485-41ca-8976-c99ce24dce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:23.002681 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b067-c485-41ca-8976-c99ce24dce00 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:23.003228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b067-c485-41ca-8976-c99ce24dce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:23.003228 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b067-c485-41ca-8976-c99ce24dce00 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:23.003779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262b067-c485-41ca-8976-c99ce24dce00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:23.007976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262b067-c485-41ca-8976-c99ce24dce00 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:23.053061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1269/2539] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:22 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:23.057527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce3d0a-b63c-4b1d-95ab-c9b06386981c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:23.068475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce3d0a-b63c-4b1d-95ab-c9b06386981c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:23.075049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a671c-d83f-4ffd-a764-ad3a8bb3d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:23.075842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a671c-d83f-4ffd-a764-ad3a8bb3d41e admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:23.076127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a671c-d83f-4ffd-a764-ad3a8bb3d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:23.076398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a671c-d83f-4ffd-a764-ad3a8bb3d41e admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:23.077064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a671c-d83f-4ffd-a764-ad3a8bb3d41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:23.078674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a671c-d83f-4ffd-a764-ad3a8bb3d41e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:23.091449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1271/2540] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:27:23.095473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262b067-c485-41ca-8976-c99ce24dce00 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:23.108073 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262b067-c485-41ca-8976-c99ce24dce00 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:23.112940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ba7d-1d77-4f0d-920c-bf71318f1920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:23.113576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ba7d-1d77-4f0d-920c-bf71318f1920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:23.113853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ba7d-1d77-4f0d-920c-bf71318f1920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:23.114133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ba7d-1d77-4f0d-920c-bf71318f1920 admin admin] PATH_INFO: `/v3/projects/b772f125b8b748e188b59d37720da295/users/d69683e847404ab9a9b96cce3a850cb5/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:23.138876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38ba7d-1d77-4f0d-920c-bf71318f1920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b772f125b8b748e188b59d37720da295, user_id=d69683e847404ab9a9b96cce3a850cb5, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:23.141845 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38ba7d-1d77-4f0d-920c-bf71318f1920 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:23.164812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1270/2541] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:23 2022] PUT /identity/v3/projects/b772f125b8b748e188b59d37720da295/users/d69683e847404ab9a9b96cce3a850cb5/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:23.168844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a671c-d83f-4ffd-a764-ad3a8bb3d41e admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:23.180300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a671c-d83f-4ffd-a764-ad3a8bb3d41e admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:23.248497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0aeba-e0e2-4ae5-983e-a884b6b7e059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:23.249265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0aeba-e0e2-4ae5-983e-a884b6b7e059 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:23.249590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0aeba-e0e2-4ae5-983e-a884b6b7e059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:23.249902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0aeba-e0e2-4ae5-983e-a884b6b7e059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:23.250541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0aeba-e0e2-4ae5-983e-a884b6b7e059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:23.252152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0aeba-e0e2-4ae5-983e-a884b6b7e059 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:23.267558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1272/2542] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:23.270781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ba7d-1d77-4f0d-920c-bf71318f1920 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:23.288276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ba7d-1d77-4f0d-920c-bf71318f1920 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:23.295535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3bb6-ced6-43ba-bf6d-5415b1ec2a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:23.296261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3bb6-ced6-43ba-bf6d-5415b1ec2a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:23.296481 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3bb6-ced6-43ba-bf6d-5415b1ec2a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:23.296794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3bb6-ced6-43ba-bf6d-5415b1ec2a99 admin admin] PATH_INFO: `/v3/projects/b772f125b8b748e188b59d37720da295/users/d69683e847404ab9a9b96cce3a850cb5/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:23.299147 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d3bb6-ced6-43ba-bf6d-5415b1ec2a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b772f125b8b748e188b59d37720da295, user_id=d69683e847404ab9a9b96cce3a850cb5, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:23.302095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d3bb6-ced6-43ba-bf6d-5415b1ec2a99 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:23.314466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1271/2543] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:23 2022] PUT /identity/v3/projects/b772f125b8b748e188b59d37720da295/users/d69683e847404ab9a9b96cce3a850cb5/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:23.326926 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667384-58b4-4d30-9b16-d1a8a86fdf61 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:23.327214 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667384-58b4-4d30-9b16-d1a8a86fdf61 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:23.327488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667384-58b4-4d30-9b16-d1a8a86fdf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:23.361030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c8667384-58b4-4d30-9b16-d1a8a86fdf61 None None] MFA Rules not processed for user `d69683e847404ab9a9b96cce3a850cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:23.362283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c8667384-58b4-4d30-9b16-d1a8a86fdf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:23.443887 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:23.449542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1273/2544] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:27:23.464461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3bb6-ced6-43ba-bf6d-5415b1ec2a99 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:23.466438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-109d3bb6-ced6-43ba-bf6d-5415b1ec2a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:23.537343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3bb6-ced6-43ba-bf6d-5415b1ec2a99 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:23.541663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761f046-d1e6-4ba3-8b88-c9a47d251457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:23.542299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761f046-d1e6-4ba3-8b88-c9a47d251457 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:23.542575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761f046-d1e6-4ba3-8b88-c9a47d251457 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:23.542910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761f046-d1e6-4ba3-8b88-c9a47d251457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:23.554913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761f046-d1e6-4ba3-8b88-c9a47d251457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:23.556272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761f046-d1e6-4ba3-8b88-c9a47d251457 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:23.570190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1272/2545] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:24.051324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8667384-58b4-4d30-9b16-d1a8a86fdf61 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:24.126139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8667384-58b4-4d30-9b16-d1a8a86fdf61 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:24.130891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:24.131741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:24.132095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:24.132511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] PATH_INFO: `/v3/users/de6470ef296e40f882707ed30cf1c2de` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:24.133880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6470ef296e40f882707ed30cf1c2de)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:24.135883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:24.212375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6470ef296e40f882707ed30cf1c2de'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:24.223908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6470ef296e40f882707ed30cf1c2de'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:24.224616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6470ef296e40f882707ed30cf1c2de'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:24.225995 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6470ef296e40f882707ed30cf1c2de'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:24.234275 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6470ef296e40f882707ed30cf1c2de'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:24.259149 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1274/2546] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:24 2022] DELETE /identity/v3/users/de6470ef296e40f882707ed30cf1c2de => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:24.263465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e369-86d0-486e-9a0a-896b39cefc8e None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:24.263760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e369-86d0-486e-9a0a-896b39cefc8e None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:24.264025 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e369-86d0-486e-9a0a-896b39cefc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:24.289523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-8019e369-86d0-486e-9a0a-896b39cefc8e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:24.292660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8019e369-86d0-486e-9a0a-896b39cefc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:24.388118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1273/2547] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:24.394881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:24.396394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:24.481800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0006d-5007-4b85-a50e-089d0f891ab0 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:24.485716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d27c06-3214-4939-b9c2-1a4a1264da0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:24.486436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d27c06-3214-4939-b9c2-1a4a1264da0e service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:24.486911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d27c06-3214-4939-b9c2-1a4a1264da0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:24.487280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d27c06-3214-4939-b9c2-1a4a1264da0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:24.500545 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d27c06-3214-4939-b9c2-1a4a1264da0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:24.503223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d27c06-3214-4939-b9c2-1a4a1264da0e service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:24.516824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1275/2548] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:24.864955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019e369-86d0-486e-9a0a-896b39cefc8e None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:24.866715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-8019e369-86d0-486e-9a0a-896b39cefc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:24.895234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019e369-86d0-486e-9a0a-896b39cefc8e None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:24.910701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:24.911359 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:24.911633 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:24.911895 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] PATH_INFO: `/v3/projects/38e4b5c2a01b4ca2bd9d09c5a24db0d0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:24.914094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e4b5c2a01b4ca2bd9d09c5a24db0d0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:24.916009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:24.938101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:24.998722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e4b5c2a01b4ca2bd9d09c5a24db0d0', 'request_id': 'req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.008860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e4b5c2a01b4ca2bd9d09c5a24db0d0', 'request_id': 'req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.017634 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e4b5c2a01b4ca2bd9d09c5a24db0d0', 'request_id': 'req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.029566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] The token cache is being invalidate because project 38e4b5c2a01b4ca2bd9d09c5a24db0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:25.029888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.032120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.033893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1274/2549] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:24 2022] DELETE /identity/v3/projects/38e4b5c2a01b4ca2bd9d09c5a24db0d0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:25.038534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d27c06-3214-4939-b9c2-1a4a1264da0e service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:25.050816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d27c06-3214-4939-b9c2-1a4a1264da0e service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:25.077777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:25.127883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:25.128645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:25.129059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:25.129404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] PATH_INFO: `/v3/users/d69683e847404ab9a9b96cce3a850cb5` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:25.130622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69683e847404ab9a9b96cce3a850cb5)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:25.133265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:25.206170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69683e847404ab9a9b96cce3a850cb5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.216879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69683e847404ab9a9b96cce3a850cb5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.220518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69683e847404ab9a9b96cce3a850cb5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.222283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69683e847404ab9a9b96cce3a850cb5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.230601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e374dfa4-f193-4fe6-9ea9-911613da674d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69683e847404ab9a9b96cce3a850cb5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.255912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1276/2550] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:25 2022] DELETE /identity/v3/users/d69683e847404ab9a9b96cce3a850cb5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:25.637811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:25.639331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:25.655473 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9ed2b-fe4f-438b-a289-dc487ad4eca6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:25.726338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:25.726942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:25.727223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:25.727497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] PATH_INFO: `/v3/projects/b772f125b8b748e188b59d37720da295` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:25.728742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b772f125b8b748e188b59d37720da295)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:25.730702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:25.784774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b772f125b8b748e188b59d37720da295', 'request_id': 'req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.791560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b772f125b8b748e188b59d37720da295', 'request_id': 'req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.799852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b772f125b8b748e188b59d37720da295', 'request_id': 'req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.813723 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] The token cache is being invalidate because project b772f125b8b748e188b59d37720da295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:25.814021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.814693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-83c935ac-9e29-4ede-bbb9-0f663c9ca6e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:25.822578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1275/2551] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:25 2022] DELETE /identity/v3/projects/b772f125b8b748e188b59d37720da295 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:25.846770 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbfa0e-a3e7-4d91-a865-5a8b4183ebf8 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:25.847394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbfa0e-a3e7-4d91-a865-5a8b4183ebf8 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:25.847394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbfa0e-a3e7-4d91-a865-5a8b4183ebf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:25.868128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-59cbfa0e-a3e7-4d91-a865-5a8b4183ebf8 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:25.869385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-59cbfa0e-a3e7-4d91-a865-5a8b4183ebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:25.945547 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1277/2552] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:25.953452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61e1ab-8276-4aeb-a302-370d11bc4f80 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:25.954033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61e1ab-8276-4aeb-a302-370d11bc4f80 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:25.954146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61e1ab-8276-4aeb-a302-370d11bc4f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:25.978871 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fb61e1ab-8276-4aeb-a302-370d11bc4f80 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:25.980205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fb61e1ab-8276-4aeb-a302-370d11bc4f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:25.988356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1276/2553] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:25.993338 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbfa0e-a3e7-4d91-a865-5a8b4183ebf8 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.005725 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbfa0e-a3e7-4d91-a865-5a8b4183ebf8 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.012893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1460c-d665-451a-b885-ecc5d692958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.014176 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1460c-d665-451a-b885-ecc5d692958d admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.014462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1460c-d665-451a-b885-ecc5d692958d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.014726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1460c-d665-451a-b885-ecc5d692958d admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.015371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1460c-d665-451a-b885-ecc5d692958d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:27:26.015674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1460c-d665-451a-b885-ecc5d692958d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.017322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1460c-d665-451a-b885-ecc5d692958d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.036670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1278/2554] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:27:26.040128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61e1ab-8276-4aeb-a302-370d11bc4f80 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.050554 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61e1ab-8276-4aeb-a302-370d11bc4f80 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.055950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243ea6-2c57-431e-9f70-d1dbdf43f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.056559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243ea6-2c57-431e-9f70-d1dbdf43f716 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.056943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243ea6-2c57-431e-9f70-d1dbdf43f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.057213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243ea6-2c57-431e-9f70-d1dbdf43f716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.057839 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae243ea6-2c57-431e-9f70-d1dbdf43f716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.060987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae243ea6-2c57-431e-9f70-d1dbdf43f716 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.100925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1277/2555] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:26 2022] POST /identity/v3/projects => generated 407 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:26.103139 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1460c-d665-451a-b885-ecc5d692958d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.116322 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1460c-d665-451a-b885-ecc5d692958d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.151270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:26.191041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ea6b-b309-405f-a665-0be1c14620c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.191812 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ea6b-b309-405f-a665-0be1c14620c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.192147 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ea6b-b309-405f-a665-0be1c14620c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.192515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ea6b-b309-405f-a665-0be1c14620c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.193281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9ea6b-b309-405f-a665-0be1c14620c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.196478 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9ea6b-b309-405f-a665-0be1c14620c2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.223541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1279/2556] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:26 2022] POST /identity/v3/users => generated 304 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:26.231282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243ea6-2c57-431e-9f70-d1dbdf43f716 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.237261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:26.249005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243ea6-2c57-431e-9f70-d1dbdf43f716 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.254739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156517df-2fee-4bf2-92d8-dcebbee71bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.255582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156517df-2fee-4bf2-92d8-dcebbee71bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.256086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156517df-2fee-4bf2-92d8-dcebbee71bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.256697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156517df-2fee-4bf2-92d8-dcebbee71bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.257557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156517df-2fee-4bf2-92d8-dcebbee71bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.259286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156517df-2fee-4bf2-92d8-dcebbee71bb7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.274132 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1278/2557] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:26.275400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ea6b-b309-405f-a665-0be1c14620c2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.285893 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ea6b-b309-405f-a665-0be1c14620c2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.295158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783574e-31f0-4757-88d9-9b5ade11c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.295861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783574e-31f0-4757-88d9-9b5ade11c44e admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.296136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783574e-31f0-4757-88d9-9b5ade11c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.296401 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783574e-31f0-4757-88d9-9b5ade11c44e admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.297073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783574e-31f0-4757-88d9-9b5ade11c44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.298971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783574e-31f0-4757-88d9-9b5ade11c44e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.315589 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1280/2558] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:26.316761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156517df-2fee-4bf2-92d8-dcebbee71bb7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.329990 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156517df-2fee-4bf2-92d8-dcebbee71bb7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.335363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d052b-c638-4ddd-8b1a-18bc99a27b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.336013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d052b-c638-4ddd-8b1a-18bc99a27b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.336287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d052b-c638-4ddd-8b1a-18bc99a27b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.336556 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d052b-c638-4ddd-8b1a-18bc99a27b91 admin admin] PATH_INFO: `/v3/projects/08a43869de7f4c94a0de56a8e15c274d/users/fe2f6af8d10a4864be0cfb1fd5a84f55/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.356095 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d052b-c638-4ddd-8b1a-18bc99a27b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a43869de7f4c94a0de56a8e15c274d, user_id=fe2f6af8d10a4864be0cfb1fd5a84f55, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.358762 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d052b-c638-4ddd-8b1a-18bc99a27b91 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.373994 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1279/2559] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:26 2022] PUT /identity/v3/projects/08a43869de7f4c94a0de56a8e15c274d/users/fe2f6af8d10a4864be0cfb1fd5a84f55/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:26.386029 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3358-caf8-4c65-84b4-6bf2b960644f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.386389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3358-caf8-4c65-84b4-6bf2b960644f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.386723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3358-caf8-4c65-84b4-6bf2b960644f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.420445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-444b3358-caf8-4c65-84b4-6bf2b960644f None None] MFA Rules not processed for user `fe2f6af8d10a4864be0cfb1fd5a84f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:26.422048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-444b3358-caf8-4c65-84b4-6bf2b960644f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:26.492551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1281/2560] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:26 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:26.497341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d052b-c638-4ddd-8b1a-18bc99a27b91 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.574529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d052b-c638-4ddd-8b1a-18bc99a27b91 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.579783 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ff32d-16c8-4a8f-8622-5814896a1935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.580417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff32d-16c8-4a8f-8622-5814896a1935 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.580748 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff32d-16c8-4a8f-8622-5814896a1935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.581021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ff32d-16c8-4a8f-8622-5814896a1935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.581756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ff32d-16c8-4a8f-8622-5814896a1935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.583534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ff32d-16c8-4a8f-8622-5814896a1935 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.617656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1280/2561] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:26 2022] POST /identity/v3/projects => generated 409 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:27:26.618939 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b3358-caf8-4c65-84b4-6bf2b960644f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.632880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b3358-caf8-4c65-84b4-6bf2b960644f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.702505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed5026-b493-4f20-9fca-3be0bcbae217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.702673 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed5026-b493-4f20-9fca-3be0bcbae217 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.702930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed5026-b493-4f20-9fca-3be0bcbae217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.703196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed5026-b493-4f20-9fca-3be0bcbae217 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.703810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed5026-b493-4f20-9fca-3be0bcbae217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.705816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed5026-b493-4f20-9fca-3be0bcbae217 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.735263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1282/2562] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:26 2022] POST /identity/v3/users => generated 311 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:26.736558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ff32d-16c8-4a8f-8622-5814896a1935 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.747281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ff32d-16c8-4a8f-8622-5814896a1935 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.752140 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e1620-7514-4cc5-ba55-9f01a484230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.752766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1620-7514-4cc5-ba55-9f01a484230a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.753047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1620-7514-4cc5-ba55-9f01a484230a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.753314 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1620-7514-4cc5-ba55-9f01a484230a admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.753950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e1620-7514-4cc5-ba55-9f01a484230a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.755580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e1620-7514-4cc5-ba55-9f01a484230a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.767288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1281/2563] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:26.772365 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed5026-b493-4f20-9fca-3be0bcbae217 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.782370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed5026-b493-4f20-9fca-3be0bcbae217 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.787100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b810263-e20a-4b26-803a-339a49b146a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.787865 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b810263-e20a-4b26-803a-339a49b146a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.788152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b810263-e20a-4b26-803a-339a49b146a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.788423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b810263-e20a-4b26-803a-339a49b146a0 admin admin] PATH_INFO: `/v3/projects/584fa6da7b6b4012a69fb5397d53a919/users/a617373e4cad469ca2ca818a815cbbb6/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.803853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b810263-e20a-4b26-803a-339a49b146a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584fa6da7b6b4012a69fb5397d53a919, user_id=a617373e4cad469ca2ca818a815cbbb6, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.806573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b810263-e20a-4b26-803a-339a49b146a0 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.819823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1283/2564] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:26 2022] PUT /identity/v3/projects/584fa6da7b6b4012a69fb5397d53a919/users/a617373e4cad469ca2ca818a815cbbb6/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:26.823810 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e1620-7514-4cc5-ba55-9f01a484230a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.833917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e1620-7514-4cc5-ba55-9f01a484230a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.891066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1d2f0-f8e2-4935-ba36-9a90f9b8dae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.891661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1d2f0-f8e2-4935-ba36-9a90f9b8dae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.891936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1d2f0-f8e2-4935-ba36-9a90f9b8dae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.892202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1d2f0-f8e2-4935-ba36-9a90f9b8dae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.892851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1d2f0-f8e2-4935-ba36-9a90f9b8dae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.894419 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1d2f0-f8e2-4935-ba36-9a90f9b8dae1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.904300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1282/2565] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:26.908354 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b810263-e20a-4b26-803a-339a49b146a0 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:26.914256 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:26.920693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b810263-e20a-4b26-803a-339a49b146a0 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:26.925935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500dbe1-48c0-4d5e-86dc-c85a412a19d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:26.926575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500dbe1-48c0-4d5e-86dc-c85a412a19d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.926849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500dbe1-48c0-4d5e-86dc-c85a412a19d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.927121 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500dbe1-48c0-4d5e-86dc-c85a412a19d0 admin admin] PATH_INFO: `/v3/projects/584fa6da7b6b4012a69fb5397d53a919/users/a617373e4cad469ca2ca818a815cbbb6/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.929623 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500dbe1-48c0-4d5e-86dc-c85a412a19d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584fa6da7b6b4012a69fb5397d53a919, user_id=a617373e4cad469ca2ca818a815cbbb6, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:26.932225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500dbe1-48c0-4d5e-86dc-c85a412a19d0 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:26.942308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1284/2566] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:26 2022] PUT /identity/v3/projects/584fa6da7b6b4012a69fb5397d53a919/users/a617373e4cad469ca2ca818a815cbbb6/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:26.954408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4917-4c90-4793-93d6-9e5e72e32794 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:26.954904 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4917-4c90-4793-93d6-9e5e72e32794 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:26.955018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4917-4c90-4793-93d6-9e5e72e32794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:26.984215 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a7bd4917-4c90-4793-93d6-9e5e72e32794 None None] MFA Rules not processed for user `a617373e4cad469ca2ca818a815cbbb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:26.985429 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a7bd4917-4c90-4793-93d6-9e5e72e32794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:27.137250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:27.181066 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1283/2567] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:26 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:27.192771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500dbe1-48c0-4d5e-86dc-c85a412a19d0 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:27.195080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-7500dbe1-48c0-4d5e-86dc-c85a412a19d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:27.254431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500dbe1-48c0-4d5e-86dc-c85a412a19d0 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:27.258366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049edb3-5975-4406-9ca8-5181f2f6f954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:27.258998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049edb3-5975-4406-9ca8-5181f2f6f954 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:27.259276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049edb3-5975-4406-9ca8-5181f2f6f954 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:27.259546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049edb3-5975-4406-9ca8-5181f2f6f954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:27.269565 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049edb3-5975-4406-9ca8-5181f2f6f954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:27.271199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049edb3-5975-4406-9ca8-5181f2f6f954 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:27.281120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1285/2568] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:27 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:27.435102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd4917-4c90-4793-93d6-9e5e72e32794 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:27.445267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd4917-4c90-4793-93d6-9e5e72e32794 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:27.448803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95d049-4523-438a-8724-5ea764815009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:27.449406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95d049-4523-438a-8724-5ea764815009 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:27.449677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95d049-4523-438a-8724-5ea764815009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:27.449972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95d049-4523-438a-8724-5ea764815009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:27.509767 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95d049-4523-438a-8724-5ea764815009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:27.511282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95d049-4523-438a-8724-5ea764815009 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:27.520561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1284/2569] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:27 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:31.237473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00e072-03d9-4630-8c97-1a8cc2cc7c27 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:31.237998 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00e072-03d9-4630-8c97-1a8cc2cc7c27 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:31.238194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00e072-03d9-4630-8c97-1a8cc2cc7c27 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:31.239613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1286/2570] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:27:31.246865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45d14a-1d6a-4463-bbf2-f2f9f4b4cf25 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:31.247329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45d14a-1d6a-4463-bbf2-f2f9f4b4cf25 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:31.247448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45d14a-1d6a-4463-bbf2-f2f9f4b4cf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:31.268122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7b45d14a-1d6a-4463-bbf2-f2f9f4b4cf25 None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:31.268927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7b45d14a-1d6a-4463-bbf2-f2f9f4b4cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:31.341293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1285/2571] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:27:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:27:31.354006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00e072-03d9-4630-8c97-1a8cc2cc7c27 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:31.355719 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-fd00e072-03d9-4630-8c97-1a8cc2cc7c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:31.415185 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00e072-03d9-4630-8c97-1a8cc2cc7c27 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:31.418827 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b68637-3f4b-4d42-b342-eb157f80756d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79efccae1afa46e78c25f617bf2dd9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:31.419434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b68637-3f4b-4d42-b342-eb157f80756d service glance] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:31.419709 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b68637-3f4b-4d42-b342-eb157f80756d service glance] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:31.419979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b68637-3f4b-4d42-b342-eb157f80756d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:31.432151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b68637-3f4b-4d42-b342-eb157f80756d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:31.433619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b68637-3f4b-4d42-b342-eb157f80756d service glance] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:31.444867 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1287/2572] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:31.513920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047cd4-217d-4d49-a209-bf209a0b06e8 None None] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:31.514197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047cd4-217d-4d49-a209-bf209a0b06e8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:31.514460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047cd4-217d-4d49-a209-bf209a0b06e8 None None] PATH_INFO: `/` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:31.515799 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1286/2573] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:27:31.523205 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadf14-1d4c-4fb0-b905-b434ad4003ed None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:31.523490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadf14-1d4c-4fb0-b905-b434ad4003ed None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:31.523762 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadf14-1d4c-4fb0-b905-b434ad4003ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:31.542952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-20cadf14-1d4c-4fb0-b905-b434ad4003ed None None] MFA Rules not processed for user `13063cbf860c4ca98666500c3c125933`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:31.544141 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-20cadf14-1d4c-4fb0-b905-b434ad4003ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:31.602345 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1288/2574] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:27:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:31.616223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e047cd4-217d-4d49-a209-bf209a0b06e8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:31.618022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6e047cd4-217d-4d49-a209-bf209a0b06e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:31.632371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e047cd4-217d-4d49-a209-bf209a0b06e8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:31.635938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943412a2-dc38-44c9-b8fa-06acc56818d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:31.636529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943412a2-dc38-44c9-b8fa-06acc56818d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:31.636833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943412a2-dc38-44c9-b8fa-06acc56818d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:31.637103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943412a2-dc38-44c9-b8fa-06acc56818d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:31.644119 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943412a2-dc38-44c9-b8fa-06acc56818d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:31.645567 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943412a2-dc38-44c9-b8fa-06acc56818d9 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:31.653263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1287/2575] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:31.742912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508aff55-a9c1-44ff-a86d-7cf013fd9942 None None] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:31.743215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508aff55-a9c1-44ff-a86d-7cf013fd9942 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:31.743698 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508aff55-a9c1-44ff-a86d-7cf013fd9942 None None] PATH_INFO: `/` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:31.745106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1289/2576] 10.222.0.25 () {54 vars in 921 bytes} [Tue Aug 9 12:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:27:31.750991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e356ab-709f-4958-81e5-2e439176a43d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:31.751273 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e356ab-709f-4958-81e5-2e439176a43d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:31.751544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e356ab-709f-4958-81e5-2e439176a43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:31.772803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d7e356ab-709f-4958-81e5-2e439176a43d None None] MFA Rules not processed for user `98925192a33544e081f1a02faed60b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:31.774150 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d7e356ab-709f-4958-81e5-2e439176a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:31.784040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1288/2577] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Aug 9 12:27:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:31.794576 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508aff55-a9c1-44ff-a86d-7cf013fd9942 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:31.805883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508aff55-a9c1-44ff-a86d-7cf013fd9942 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:31.809489 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6ec1-0de1-48bd-945a-e6a8cb546473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:31.810072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6ec1-0de1-48bd-945a-e6a8cb546473 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:31.810343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6ec1-0de1-48bd-945a-e6a8cb546473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:31.810616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6ec1-0de1-48bd-945a-e6a8cb546473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:31.821487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b6ec1-0de1-48bd-945a-e6a8cb546473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:31.822907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b6ec1-0de1-48bd-945a-e6a8cb546473 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:31.833515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1290/2578] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:31.899704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e356ab-709f-4958-81e5-2e439176a43d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:31.901107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d7e356ab-709f-4958-81e5-2e439176a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:31.934511 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:31.967812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e356ab-709f-4958-81e5-2e439176a43d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:31.972769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dd68c-33ca-4ad6-b79b-bb91ef4ffef6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:31.973364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dd68c-33ca-4ad6-b79b-bb91ef4ffef6 service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:31.973639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dd68c-33ca-4ad6-b79b-bb91ef4ffef6 service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:31.973906 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dd68c-33ca-4ad6-b79b-bb91ef4ffef6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:31.975949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e82dd68c-33ca-4ad6-b79b-bb91ef4ffef6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:31.987105 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dd68c-33ca-4ad6-b79b-bb91ef4ffef6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:31.988670 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dd68c-33ca-4ad6-b79b-bb91ef4ffef6 service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:31.998831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1289/2579] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:32.799573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6ec1-0de1-48bd-945a-e6a8cb546473 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:32.834990 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:32.866334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6ec1-0de1-48bd-945a-e6a8cb546473 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:32.871063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:32.871694 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:32.871968 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:32.872237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] PATH_INFO: `/v3/users/fe2f6af8d10a4864be0cfb1fd5a84f55` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:32.873376 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2f6af8d10a4864be0cfb1fd5a84f55)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:32.875303 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:32.922601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2f6af8d10a4864be0cfb1fd5a84f55'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:32.931488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2f6af8d10a4864be0cfb1fd5a84f55'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:32.932127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2f6af8d10a4864be0cfb1fd5a84f55'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:32.932757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2f6af8d10a4864be0cfb1fd5a84f55'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:32.939907 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2f6af8d10a4864be0cfb1fd5a84f55'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:32.958571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1291/2580] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:32 2022] DELETE /identity/v3/users/fe2f6af8d10a4864be0cfb1fd5a84f55 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:32.964198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac97b4-728f-4261-b0f9-20727169f91f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:32.964733 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac97b4-728f-4261-b0f9-20727169f91f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:32.964837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac97b4-728f-4261-b0f9-20727169f91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:32.983319 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e2ac97b4-728f-4261-b0f9-20727169f91f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:32.984502 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e2ac97b4-728f-4261-b0f9-20727169f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:33.044773 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1290/2581] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:33.055367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:33.056791 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:33.116009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1c1f-da06-42b1-9a4a-3ba57d9ab768 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:33.119607 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1103a-8f1b-4379-9784-cee95a5b4cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:33.120206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1103a-8f1b-4379-9784-cee95a5b4cdb service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:33.120487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1103a-8f1b-4379-9784-cee95a5b4cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:33.120813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1103a-8f1b-4379-9784-cee95a5b4cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:33.129949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1103a-8f1b-4379-9784-cee95a5b4cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:33.131486 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1103a-8f1b-4379-9784-cee95a5b4cdb service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:33.141134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1292/2582] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:33.429539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac97b4-728f-4261-b0f9-20727169f91f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:33.431018 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e2ac97b4-728f-4261-b0f9-20727169f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:33.444739 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac97b4-728f-4261-b0f9-20727169f91f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:33.450574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:33.451234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:33.451501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:33.451772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] PATH_INFO: `/v3/projects/08a43869de7f4c94a0de56a8e15c274d` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:33.452971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a43869de7f4c94a0de56a8e15c274d)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:33.456054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:33.508235 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a43869de7f4c94a0de56a8e15c274d', 'request_id': 'req-495ca031-f689-487b-99b8-f0a6254f3f52'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:33.514371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a43869de7f4c94a0de56a8e15c274d', 'request_id': 'req-495ca031-f689-487b-99b8-f0a6254f3f52'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:33.519744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321026a-62cc-4ca2-831b-5b5881423551 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:33.520171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321026a-62cc-4ca2-831b-5b5881423551 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:33.520560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321026a-62cc-4ca2-831b-5b5881423551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:33.523325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a43869de7f4c94a0de56a8e15c274d', 'request_id': 'req-495ca031-f689-487b-99b8-f0a6254f3f52'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:33.536301 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] The token cache is being invalidate because project 08a43869de7f4c94a0de56a8e15c274d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:33.536587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:33.537548 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:33.539318 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1291/2583] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:33 2022] DELETE /identity/v3/projects/08a43869de7f4c94a0de56a8e15c274d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:33.541801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-8321026a-62cc-4ca2-831b-5b5881423551 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:33.542957 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:33.543106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8321026a-62cc-4ca2-831b-5b5881423551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:33.544219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:33.599994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:33.601074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:33.614735 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1293/2584] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:27:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:27:33.628208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ca031-f689-487b-99b8-f0a6254f3f52 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:33.630586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321026a-62cc-4ca2-831b-5b5881423551 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:33.633068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8321026a-62cc-4ca2-831b-5b5881423551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:33.634292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:33.634942 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:33.635221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:33.635494 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] PATH_INFO: `/v3/users/a617373e4cad469ca2ca818a815cbbb6` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:33.636655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a617373e4cad469ca2ca818a815cbbb6)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:33.638725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:33.702559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a617373e4cad469ca2ca818a815cbbb6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:33.711920 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a617373e4cad469ca2ca818a815cbbb6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:33.712642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a617373e4cad469ca2ca818a815cbbb6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:33.713272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a617373e4cad469ca2ca818a815cbbb6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:33.722459 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a617373e4cad469ca2ca818a815cbbb6'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:33.722794 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321026a-62cc-4ca2-831b-5b5881423551 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:33.728446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455886b1-83b2-482a-b3c3-062cfc0c73da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:33.729192 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455886b1-83b2-482a-b3c3-062cfc0c73da service swift] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:33.729501 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455886b1-83b2-482a-b3c3-062cfc0c73da service swift] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:33.729755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455886b1-83b2-482a-b3c3-062cfc0c73da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:33.731557 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-455886b1-83b2-482a-b3c3-062cfc0c73da service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:33.743612 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1292/2585] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:33 2022] DELETE /identity/v3/users/a617373e4cad469ca2ca818a815cbbb6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:33.747312 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455886b1-83b2-482a-b3c3-062cfc0c73da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:33.748953 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455886b1-83b2-482a-b3c3-062cfc0c73da service swift] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:33.760920 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1294/2586] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:27:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 12:27:34.135282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:34.136756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:34.246218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a90171-b3cc-4062-b32e-c9b6f730d62e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:34.254405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:34.255171 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:34.255678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:34.256126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] PATH_INFO: `/v3/projects/584fa6da7b6b4012a69fb5397d53a919` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:34.257410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=584fa6da7b6b4012a69fb5397d53a919)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:34.259519 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:34.317989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584fa6da7b6b4012a69fb5397d53a919', 'request_id': 'req-92e63a27-665d-42f0-80df-312c701f8f5e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:34.324499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584fa6da7b6b4012a69fb5397d53a919', 'request_id': 'req-92e63a27-665d-42f0-80df-312c701f8f5e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:34.341834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584fa6da7b6b4012a69fb5397d53a919', 'request_id': 'req-92e63a27-665d-42f0-80df-312c701f8f5e'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:34.357650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:34.373007 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] The token cache is being invalidate because project 584fa6da7b6b4012a69fb5397d53a919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:34.377220 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:34.378380 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-92e63a27-665d-42f0-80df-312c701f8f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:34.382088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1293/2587] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:34 2022] DELETE /identity/v3/projects/584fa6da7b6b4012a69fb5397d53a919 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:34.388133 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9916103-d174-4d2d-a2df-16d87dfb4650 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:34.388764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9916103-d174-4d2d-a2df-16d87dfb4650 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:34.389046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9916103-d174-4d2d-a2df-16d87dfb4650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:34.417302 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c9916103-d174-4d2d-a2df-16d87dfb4650 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:34.418551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c9916103-d174-4d2d-a2df-16d87dfb4650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:34.495841 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1295/2588] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:34.503648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953a28a-8299-4148-a715-529c5dfbed55 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:34.503905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953a28a-8299-4148-a715-529c5dfbed55 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:34.504331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953a28a-8299-4148-a715-529c5dfbed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:34.525592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e953a28a-8299-4148-a715-529c5dfbed55 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:34.526821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e953a28a-8299-4148-a715-529c5dfbed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:34.535179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1294/2589] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:34.539594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9916103-d174-4d2d-a2df-16d87dfb4650 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:34.550135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9916103-d174-4d2d-a2df-16d87dfb4650 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:34.555626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a42d-d0a5-415d-8286-70cc4ac7dc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:34.556232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a42d-d0a5-415d-8286-70cc4ac7dc4b admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:34.556506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a42d-d0a5-415d-8286-70cc4ac7dc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:34.556807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a42d-d0a5-415d-8286-70cc4ac7dc4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:34.557447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107a42d-d0a5-415d-8286-70cc4ac7dc4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:27:34.557747 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107a42d-d0a5-415d-8286-70cc4ac7dc4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:34.559373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107a42d-d0a5-415d-8286-70cc4ac7dc4b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:34.576851 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1296/2590] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:27:34.578250 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953a28a-8299-4148-a715-529c5dfbed55 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:34.588308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953a28a-8299-4148-a715-529c5dfbed55 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:34.592967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f320d7-6912-4888-85ed-919e8be080d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:34.593563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f320d7-6912-4888-85ed-919e8be080d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:34.593840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f320d7-6912-4888-85ed-919e8be080d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:34.594106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f320d7-6912-4888-85ed-919e8be080d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:34.594735 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f320d7-6912-4888-85ed-919e8be080d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:34.596611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f320d7-6912-4888-85ed-919e8be080d1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:34.623962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1295/2591] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:34 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:34.628288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a42d-d0a5-415d-8286-70cc4ac7dc4b admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:34.639618 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a42d-d0a5-415d-8286-70cc4ac7dc4b admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:34.720972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984d23-3f1b-4ce9-8383-cc32ee147a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:34.721913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984d23-3f1b-4ce9-8383-cc32ee147a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:34.722448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984d23-3f1b-4ce9-8383-cc32ee147a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:34.723059 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984d23-3f1b-4ce9-8383-cc32ee147a1e admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:34.723797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b984d23-3f1b-4ce9-8383-cc32ee147a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:34.727092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b984d23-3f1b-4ce9-8383-cc32ee147a1e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:34.751519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1297/2592] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:34 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:34.756534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f320d7-6912-4888-85ed-919e8be080d1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:34.767931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f320d7-6912-4888-85ed-919e8be080d1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:34.773316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61828c3c-315e-43dd-85f6-716dfc640d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:34.773888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61828c3c-315e-43dd-85f6-716dfc640d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:34.774151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61828c3c-315e-43dd-85f6-716dfc640d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:34.774418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61828c3c-315e-43dd-85f6-716dfc640d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:34.775052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61828c3c-315e-43dd-85f6-716dfc640d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:34.776687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61828c3c-315e-43dd-85f6-716dfc640d69 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:34.788162 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1296/2593] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:34.792528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984d23-3f1b-4ce9-8383-cc32ee147a1e admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:34.800173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:34.808513 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984d23-3f1b-4ce9-8383-cc32ee147a1e admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:34.814692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb61c16-428b-4c28-932a-d4ae653572b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:34.815473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb61c16-428b-4c28-932a-d4ae653572b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:34.816000 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb61c16-428b-4c28-932a-d4ae653572b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:34.816270 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb61c16-428b-4c28-932a-d4ae653572b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:34.816932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb61c16-428b-4c28-932a-d4ae653572b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:34.819101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb61c16-428b-4c28-932a-d4ae653572b3 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:34.833078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1298/2594] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:34.837872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61828c3c-315e-43dd-85f6-716dfc640d69 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:34.855045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61828c3c-315e-43dd-85f6-716dfc640d69 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:34.863169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32fc59-43eb-42b4-8c0f-e6a5364d6479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:34.865020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32fc59-43eb-42b4-8c0f-e6a5364d6479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:34.865722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32fc59-43eb-42b4-8c0f-e6a5364d6479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:34.866214 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32fc59-43eb-42b4-8c0f-e6a5364d6479 admin admin] PATH_INFO: `/v3/projects/41888528cac449399b7a9363dd28505c/users/3391955d817e42ada81c8c51a995fdbf/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:34.896969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32fc59-43eb-42b4-8c0f-e6a5364d6479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41888528cac449399b7a9363dd28505c, user_id=3391955d817e42ada81c8c51a995fdbf, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:34.900387 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32fc59-43eb-42b4-8c0f-e6a5364d6479 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:34.921776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1297/2595] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:34 2022] PUT /identity/v3/projects/41888528cac449399b7a9363dd28505c/users/3391955d817e42ada81c8c51a995fdbf/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:34.932517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93095a50-21b8-4f16-80d3-3fc446444104 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:34.932845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93095a50-21b8-4f16-80d3-3fc446444104 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:34.933113 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93095a50-21b8-4f16-80d3-3fc446444104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:34.980221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-93095a50-21b8-4f16-80d3-3fc446444104 None None] MFA Rules not processed for user `3391955d817e42ada81c8c51a995fdbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:34.982075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-93095a50-21b8-4f16-80d3-3fc446444104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:35.060039 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1299/2596] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:35.064529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32fc59-43eb-42b4-8c0f-e6a5364d6479 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:35.129249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32fc59-43eb-42b4-8c0f-e6a5364d6479 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:35.133925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bed212-888b-4123-876a-87cb42ef32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:35.134553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bed212-888b-4123-876a-87cb42ef32e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:35.134829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bed212-888b-4123-876a-87cb42ef32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:35.135116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bed212-888b-4123-876a-87cb42ef32e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:35.135722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bed212-888b-4123-876a-87cb42ef32e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:35.137649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bed212-888b-4123-876a-87cb42ef32e4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:35.166976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1298/2597] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:35 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:35.170644 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93095a50-21b8-4f16-80d3-3fc446444104 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:35.181731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93095a50-21b8-4f16-80d3-3fc446444104 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:35.251100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462a089-f73c-40e8-9b6a-bf7b4bdaf5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:35.251714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462a089-f73c-40e8-9b6a-bf7b4bdaf5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:35.251987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462a089-f73c-40e8-9b6a-bf7b4bdaf5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:35.252253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462a089-f73c-40e8-9b6a-bf7b4bdaf5c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:35.252931 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462a089-f73c-40e8-9b6a-bf7b4bdaf5c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:35.254855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462a089-f73c-40e8-9b6a-bf7b4bdaf5c1 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:35.284108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1300/2598] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:35 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:35.288683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bed212-888b-4123-876a-87cb42ef32e4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:35.299410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bed212-888b-4123-876a-87cb42ef32e4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:35.304881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b1ffe-e093-477c-9911-ab8e9eee95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:35.305495 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b1ffe-e093-477c-9911-ab8e9eee95c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:35.305765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b1ffe-e093-477c-9911-ab8e9eee95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:35.306039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b1ffe-e093-477c-9911-ab8e9eee95c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:35.306680 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b1ffe-e093-477c-9911-ab8e9eee95c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:35.308278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b1ffe-e093-477c-9911-ab8e9eee95c8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:35.319738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1299/2599] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:35.323814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462a089-f73c-40e8-9b6a-bf7b4bdaf5c1 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:35.334374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462a089-f73c-40e8-9b6a-bf7b4bdaf5c1 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:35.339169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595b024-300f-4ef8-b15b-9c5f68282505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:35.339829 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595b024-300f-4ef8-b15b-9c5f68282505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:35.340101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595b024-300f-4ef8-b15b-9c5f68282505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:35.340369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595b024-300f-4ef8-b15b-9c5f68282505 admin admin] PATH_INFO: `/v3/projects/1325910cb01c414eb0b7c6a4933285b5/users/973cdb221fd84ccfbd66b9c462637fe5/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:35.358125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595b024-300f-4ef8-b15b-9c5f68282505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1325910cb01c414eb0b7c6a4933285b5, user_id=973cdb221fd84ccfbd66b9c462637fe5, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:35.361210 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595b024-300f-4ef8-b15b-9c5f68282505 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:35.378109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1301/2600] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:35 2022] PUT /identity/v3/projects/1325910cb01c414eb0b7c6a4933285b5/users/973cdb221fd84ccfbd66b9c462637fe5/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:35.382237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b1ffe-e093-477c-9911-ab8e9eee95c8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:35.393349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b1ffe-e093-477c-9911-ab8e9eee95c8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:35.465876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e1d49-eed0-42bb-981a-8db82d7e49f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:35.466604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e1d49-eed0-42bb-981a-8db82d7e49f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:35.466938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e1d49-eed0-42bb-981a-8db82d7e49f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:35.467270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e1d49-eed0-42bb-981a-8db82d7e49f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:35.467991 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e1d49-eed0-42bb-981a-8db82d7e49f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:35.469650 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e1d49-eed0-42bb-981a-8db82d7e49f7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:35.483770 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1300/2601] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:35.484944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595b024-300f-4ef8-b15b-9c5f68282505 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:35.495662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595b024-300f-4ef8-b15b-9c5f68282505 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:35.503223 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56890046-3c0d-4e51-bc62-f94ca5ab6932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:35.503904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56890046-3c0d-4e51-bc62-f94ca5ab6932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:35.504187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56890046-3c0d-4e51-bc62-f94ca5ab6932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:35.504453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56890046-3c0d-4e51-bc62-f94ca5ab6932 admin admin] PATH_INFO: `/v3/projects/1325910cb01c414eb0b7c6a4933285b5/users/973cdb221fd84ccfbd66b9c462637fe5/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:35.507058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56890046-3c0d-4e51-bc62-f94ca5ab6932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1325910cb01c414eb0b7c6a4933285b5, user_id=973cdb221fd84ccfbd66b9c462637fe5, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:35.510308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56890046-3c0d-4e51-bc62-f94ca5ab6932 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:35.522922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1302/2602] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:35 2022] PUT /identity/v3/projects/1325910cb01c414eb0b7c6a4933285b5/users/973cdb221fd84ccfbd66b9c462637fe5/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:35.534464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8112f-ff2e-4513-a6fa-a532edaa4915 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:35.534903 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8112f-ff2e-4513-a6fa-a532edaa4915 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:35.535282 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8112f-ff2e-4513-a6fa-a532edaa4915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:35.543394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:35.574069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-aeb8112f-ff2e-4513-a6fa-a532edaa4915 None None] MFA Rules not processed for user `973cdb221fd84ccfbd66b9c462637fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:35.575867 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-aeb8112f-ff2e-4513-a6fa-a532edaa4915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:35.672674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1301/2603] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:35.684758 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56890046-3c0d-4e51-bc62-f94ca5ab6932 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:35.686579 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-56890046-3c0d-4e51-bc62-f94ca5ab6932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:35.730759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:35.749332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56890046-3c0d-4e51-bc62-f94ca5ab6932 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:35.753051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb1509-c30b-4882-b50a-3f93c3c51235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:35.753653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb1509-c30b-4882-b50a-3f93c3c51235 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:35.753929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb1509-c30b-4882-b50a-3f93c3c51235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:35.754199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb1509-c30b-4882-b50a-3f93c3c51235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:35.764058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb1509-c30b-4882-b50a-3f93c3c51235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:35.765533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb1509-c30b-4882-b50a-3f93c3c51235 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:35.776201 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1303/2604] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:36.199433 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8112f-ff2e-4513-a6fa-a532edaa4915 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:36.318732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8112f-ff2e-4513-a6fa-a532edaa4915 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:36.324618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:36.325357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:36.325834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:36.326130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] PATH_INFO: `/v3/users/3391955d817e42ada81c8c51a995fdbf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:36.327403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3391955d817e42ada81c8c51a995fdbf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:36.329553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:36.379730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3391955d817e42ada81c8c51a995fdbf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:36.386706 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3391955d817e42ada81c8c51a995fdbf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:36.387371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3391955d817e42ada81c8c51a995fdbf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:36.387992 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3391955d817e42ada81c8c51a995fdbf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:36.395916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3391955d817e42ada81c8c51a995fdbf'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:36.417575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1302/2605] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:36 2022] DELETE /identity/v3/users/3391955d817e42ada81c8c51a995fdbf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:36.422150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737cc66-d1b6-4af0-81b4-56515a0a3340 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:36.422504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737cc66-d1b6-4af0-81b4-56515a0a3340 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:36.422845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737cc66-d1b6-4af0-81b4-56515a0a3340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:36.442427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4737cc66-d1b6-4af0-81b4-56515a0a3340 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:36.443842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4737cc66-d1b6-4af0-81b4-56515a0a3340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:36.502502 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1304/2606] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:36.518761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:36.522568 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:36.535961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:36.606977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a98e-14ec-423c-92e4-f0e75e76df30 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:36.610553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2b937-47a6-44a8-95a8-b99981214dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:36.611154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2b937-47a6-44a8-95a8-b99981214dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:36.611428 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2b937-47a6-44a8-95a8-b99981214dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:36.611694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2b937-47a6-44a8-95a8-b99981214dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:36.621472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2b937-47a6-44a8-95a8-b99981214dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:36.622890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2b937-47a6-44a8-95a8-b99981214dc3 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:36.633317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1303/2607] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:36.933559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737cc66-d1b6-4af0-81b4-56515a0a3340 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:36.935250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4737cc66-d1b6-4af0-81b4-56515a0a3340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:36.954595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737cc66-d1b6-4af0-81b4-56515a0a3340 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:36.966630 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:36.967426 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:36.967778 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:36.968197 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] PATH_INFO: `/v3/projects/41888528cac449399b7a9363dd28505c` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:36.970484 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41888528cac449399b7a9363dd28505c)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:36.974859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:37.026405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41888528cac449399b7a9363dd28505c', 'request_id': 'req-3e9395c6-0f2f-47ba-b941-e3a742334212'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.031830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41888528cac449399b7a9363dd28505c', 'request_id': 'req-3e9395c6-0f2f-47ba-b941-e3a742334212'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.039184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41888528cac449399b7a9363dd28505c', 'request_id': 'req-3e9395c6-0f2f-47ba-b941-e3a742334212'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.050558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] The token cache is being invalidate because project 41888528cac449399b7a9363dd28505c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:37.050844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.051460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.053018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1305/2608] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:36 2022] DELETE /identity/v3/projects/41888528cac449399b7a9363dd28505c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:37.057252 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2b937-47a6-44a8-95a8-b99981214dc3 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:37.067202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2b937-47a6-44a8-95a8-b99981214dc3 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:37.136378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:37.137561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:37.138068 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:37.138559 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] PATH_INFO: `/v3/users/973cdb221fd84ccfbd66b9c462637fe5` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:37.140021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973cdb221fd84ccfbd66b9c462637fe5)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:37.142547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:37.203420 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973cdb221fd84ccfbd66b9c462637fe5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.210721 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973cdb221fd84ccfbd66b9c462637fe5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.211409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973cdb221fd84ccfbd66b9c462637fe5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.212012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973cdb221fd84ccfbd66b9c462637fe5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.220969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-9915f4aa-313b-4e8f-b9a5-2dd111be9198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973cdb221fd84ccfbd66b9c462637fe5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.241036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1304/2609] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:37 2022] DELETE /identity/v3/users/973cdb221fd84ccfbd66b9c462637fe5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:37.614130 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:37.616248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:37.635569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9395c6-0f2f-47ba-b941-e3a742334212 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:37.692473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:37.693801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:37.694074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:37.694347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] PATH_INFO: `/v3/projects/1325910cb01c414eb0b7c6a4933285b5` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:37.695431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1325910cb01c414eb0b7c6a4933285b5)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:37.697351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:37.699627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:37.744334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1325910cb01c414eb0b7c6a4933285b5', 'request_id': 'req-0a420601-3a3a-4f32-b611-c8401bd0e8f8'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.749752 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1325910cb01c414eb0b7c6a4933285b5', 'request_id': 'req-0a420601-3a3a-4f32-b611-c8401bd0e8f8'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.756870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1325910cb01c414eb0b7c6a4933285b5', 'request_id': 'req-0a420601-3a3a-4f32-b611-c8401bd0e8f8'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.772706 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] The token cache is being invalidate because project 1325910cb01c414eb0b7c6a4933285b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:37.773004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.773662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-0a420601-3a3a-4f32-b611-c8401bd0e8f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:37.775171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1306/2610] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:37 2022] DELETE /identity/v3/projects/1325910cb01c414eb0b7c6a4933285b5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:37.786062 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bc04b-0ea0-4257-a130-4c6a466899dc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:37.787158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bc04b-0ea0-4257-a130-4c6a466899dc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:37.787703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bc04b-0ea0-4257-a130-4c6a466899dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:37.822641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-5e0bc04b-0ea0-4257-a130-4c6a466899dc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:37.824940 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5e0bc04b-0ea0-4257-a130-4c6a466899dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:37.857365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:37.903643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1305/2611] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:37.911525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcaaf7-c58a-4b80-9cdc-633d41b015f0 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:37.911852 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcaaf7-c58a-4b80-9cdc-633d41b015f0 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:37.912128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcaaf7-c58a-4b80-9cdc-633d41b015f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:37.933123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-54dcaaf7-c58a-4b80-9cdc-633d41b015f0 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:37.934329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-54dcaaf7-c58a-4b80-9cdc-633d41b015f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:37.942164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1307/2612] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:37.946868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bc04b-0ea0-4257-a130-4c6a466899dc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:37.956547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bc04b-0ea0-4257-a130-4c6a466899dc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:37.961837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04ed3e-08b9-471c-86b4-a1464f5a795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:37.962440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ed3e-08b9-471c-86b4-a1464f5a795a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:37.962717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ed3e-08b9-471c-86b4-a1464f5a795a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:37.962985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ed3e-08b9-471c-86b4-a1464f5a795a admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:37.963627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04ed3e-08b9-471c-86b4-a1464f5a795a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:27:37.963927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04ed3e-08b9-471c-86b4-a1464f5a795a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:37.965550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04ed3e-08b9-471c-86b4-a1464f5a795a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:37.977583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1306/2613] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:27:37.982065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcaaf7-c58a-4b80-9cdc-633d41b015f0 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:37.991793 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcaaf7-c58a-4b80-9cdc-633d41b015f0 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:37.996615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816e514-5576-429a-b5bb-fef81e55027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:37.997159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816e514-5576-429a-b5bb-fef81e55027a admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:37.997432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816e514-5576-429a-b5bb-fef81e55027a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:37.997699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816e514-5576-429a-b5bb-fef81e55027a admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:37.998348 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816e514-5576-429a-b5bb-fef81e55027a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:38.000250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816e514-5576-429a-b5bb-fef81e55027a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:38.028267 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1308/2614] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:37 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:38.032532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04ed3e-08b9-471c-86b4-a1464f5a795a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:38.044009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04ed3e-08b9-471c-86b4-a1464f5a795a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:38.124575 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c30e-85af-4639-a058-672db773d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:38.125233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c30e-85af-4639-a058-672db773d68b admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.125517 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c30e-85af-4639-a058-672db773d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.125794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c30e-85af-4639-a058-672db773d68b admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.126438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338c30e-85af-4639-a058-672db773d68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:38.129298 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338c30e-85af-4639-a058-672db773d68b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:38.160925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1307/2615] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:38 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:38.162152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816e514-5576-429a-b5bb-fef81e55027a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:38.173902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816e514-5576-429a-b5bb-fef81e55027a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:38.179966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689a584-0162-4e43-b4b4-aa1e35233172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:38.181072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689a584-0162-4e43-b4b4-aa1e35233172 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.181640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689a584-0162-4e43-b4b4-aa1e35233172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.182276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689a584-0162-4e43-b4b4-aa1e35233172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.183310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689a584-0162-4e43-b4b4-aa1e35233172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:38.185855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689a584-0162-4e43-b4b4-aa1e35233172 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:38.204969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1309/2616] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:38.206187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c30e-85af-4639-a058-672db773d68b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:38.225112 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c30e-85af-4639-a058-672db773d68b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:38.230456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bfdad-641a-4f72-ab49-c24baf70d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:38.231071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bfdad-641a-4f72-ab49-c24baf70d12b admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.231350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bfdad-641a-4f72-ab49-c24baf70d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.231623 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bfdad-641a-4f72-ab49-c24baf70d12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.232262 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bfdad-641a-4f72-ab49-c24baf70d12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:38.233901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bfdad-641a-4f72-ab49-c24baf70d12b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:38.246183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1308/2617] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:38.250604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689a584-0162-4e43-b4b4-aa1e35233172 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:38.261371 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689a584-0162-4e43-b4b4-aa1e35233172 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:38.267507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420614cd-31f6-45e0-9c6a-3d7837aed24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:38.268217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420614cd-31f6-45e0-9c6a-3d7837aed24b admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.268498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420614cd-31f6-45e0-9c6a-3d7837aed24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.268819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420614cd-31f6-45e0-9c6a-3d7837aed24b admin admin] PATH_INFO: `/v3/projects/7062239e6afd4a208e77706d7435eaa8/users/22ef4ca54ccd443a8e4fd96851ef98fc/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.285634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420614cd-31f6-45e0-9c6a-3d7837aed24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7062239e6afd4a208e77706d7435eaa8, user_id=22ef4ca54ccd443a8e4fd96851ef98fc, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:38.289577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420614cd-31f6-45e0-9c6a-3d7837aed24b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:38.303923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1310/2618] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:38 2022] PUT /identity/v3/projects/7062239e6afd4a208e77706d7435eaa8/users/22ef4ca54ccd443a8e4fd96851ef98fc/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:38.324926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ee60-f669-4fa4-9c84-5eebca609701 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.324926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ee60-f669-4fa4-9c84-5eebca609701 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.324926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ee60-f669-4fa4-9c84-5eebca609701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.345279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-3c30ee60-f669-4fa4-9c84-5eebca609701 None None] MFA Rules not processed for user `22ef4ca54ccd443a8e4fd96851ef98fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:38.346539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-3c30ee60-f669-4fa4-9c84-5eebca609701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:38.464533 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1309/2619] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:38.468865 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420614cd-31f6-45e0-9c6a-3d7837aed24b admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:38.539854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420614cd-31f6-45e0-9c6a-3d7837aed24b admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:38.544556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67e7a-aa18-45a8-8909-b26bbf56e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:38.545281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67e7a-aa18-45a8-8909-b26bbf56e2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.545621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67e7a-aa18-45a8-8909-b26bbf56e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.545954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67e7a-aa18-45a8-8909-b26bbf56e2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.546639 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67e7a-aa18-45a8-8909-b26bbf56e2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:38.548837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67e7a-aa18-45a8-8909-b26bbf56e2a2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:38.580716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1311/2620] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:38 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:38.587558 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ee60-f669-4fa4-9c84-5eebca609701 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:38.616168 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ee60-f669-4fa4-9c84-5eebca609701 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:38.642555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:38.692778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45895ec-a7cb-44a6-a375-b1697d83dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:38.693990 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45895ec-a7cb-44a6-a375-b1697d83dd0b admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.694268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45895ec-a7cb-44a6-a375-b1697d83dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.694540 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45895ec-a7cb-44a6-a375-b1697d83dd0b admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.695244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45895ec-a7cb-44a6-a375-b1697d83dd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:38.697561 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45895ec-a7cb-44a6-a375-b1697d83dd0b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:38.730850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1310/2621] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:38 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:38.747274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67e7a-aa18-45a8-8909-b26bbf56e2a2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:38.761634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67e7a-aa18-45a8-8909-b26bbf56e2a2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:38.766627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e29d70-29da-49a9-9f93-aebd64031878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:38.767232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e29d70-29da-49a9-9f93-aebd64031878 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.767511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e29d70-29da-49a9-9f93-aebd64031878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.767783 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e29d70-29da-49a9-9f93-aebd64031878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.773369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e29d70-29da-49a9-9f93-aebd64031878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:38.775902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e29d70-29da-49a9-9f93-aebd64031878 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:38.794702 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45895ec-a7cb-44a6-a375-b1697d83dd0b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:38.802533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1312/2622] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:38.807672 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45895ec-a7cb-44a6-a375-b1697d83dd0b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:38.812448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c83bf-3000-4bda-8dd5-beaef4700cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:38.813149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c83bf-3000-4bda-8dd5-beaef4700cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.813490 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c83bf-3000-4bda-8dd5-beaef4700cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.813948 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c83bf-3000-4bda-8dd5-beaef4700cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.814653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c83bf-3000-4bda-8dd5-beaef4700cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:38.816664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c83bf-3000-4bda-8dd5-beaef4700cd2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:38.829290 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1311/2623] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:27:38.834379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e29d70-29da-49a9-9f93-aebd64031878 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:38.839803 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:38.846650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e29d70-29da-49a9-9f93-aebd64031878 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:38.853166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4399d-0deb-4694-ba18-55e184941fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:38.853897 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4399d-0deb-4694-ba18-55e184941fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.854606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4399d-0deb-4694-ba18-55e184941fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.854991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4399d-0deb-4694-ba18-55e184941fb6 admin admin] PATH_INFO: `/v3/projects/77aef4d244af463f96746319c2c75c2e/users/ce8496c105ae4133903ffcd8bfa8dcb9/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.873695 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4399d-0deb-4694-ba18-55e184941fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77aef4d244af463f96746319c2c75c2e, user_id=ce8496c105ae4133903ffcd8bfa8dcb9, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:38.876462 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4399d-0deb-4694-ba18-55e184941fb6 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:38.890895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1313/2624] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:38 2022] PUT /identity/v3/projects/77aef4d244af463f96746319c2c75c2e/users/ce8496c105ae4133903ffcd8bfa8dcb9/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:38.901744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa486a-e0f4-4490-9532-5c2c043386e2 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:38.902120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa486a-e0f4-4490-9532-5c2c043386e2 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:38.902502 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa486a-e0f4-4490-9532-5c2c043386e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:38.937472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-aafa486a-e0f4-4490-9532-5c2c043386e2 None None] MFA Rules not processed for user `ce8496c105ae4133903ffcd8bfa8dcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:38.938811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-aafa486a-e0f4-4490-9532-5c2c043386e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:39.007338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1312/2625] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:39.012031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4399d-0deb-4694-ba18-55e184941fb6 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:39.074715 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4399d-0deb-4694-ba18-55e184941fb6 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:39.079324 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7f42b-174d-4560-819a-2288cb66fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:39.079917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f42b-174d-4560-819a-2288cb66fcd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:39.080191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f42b-174d-4560-819a-2288cb66fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:39.080458 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f42b-174d-4560-819a-2288cb66fcd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:39.081162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7f42b-174d-4560-819a-2288cb66fcd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:39.083044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7f42b-174d-4560-819a-2288cb66fcd5 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:39.108631 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1314/2626] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:39 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:39.113136 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa486a-e0f4-4490-9532-5c2c043386e2 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:39.124690 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa486a-e0f4-4490-9532-5c2c043386e2 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:39.180291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2af34-7c77-48d6-99d5-5859781245d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:39.180908 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2af34-7c77-48d6-99d5-5859781245d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:39.181184 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2af34-7c77-48d6-99d5-5859781245d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:39.181482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2af34-7c77-48d6-99d5-5859781245d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:39.182093 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2af34-7c77-48d6-99d5-5859781245d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:39.183973 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2af34-7c77-48d6-99d5-5859781245d2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:39.206555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1313/2627] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:39 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:39.210771 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7f42b-174d-4560-819a-2288cb66fcd5 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:39.222503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7f42b-174d-4560-819a-2288cb66fcd5 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:39.228977 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e489a60-6927-431f-8000-ce4e50da88ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:39.229865 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e489a60-6927-431f-8000-ce4e50da88ad admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:39.230351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e489a60-6927-431f-8000-ce4e50da88ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:39.230769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e489a60-6927-431f-8000-ce4e50da88ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:39.231558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e489a60-6927-431f-8000-ce4e50da88ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:39.233445 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e489a60-6927-431f-8000-ce4e50da88ad admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:39.246732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1315/2628] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:39.250985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2af34-7c77-48d6-99d5-5859781245d2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:39.261350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2af34-7c77-48d6-99d5-5859781245d2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:39.266258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981631c-a601-4754-bc8e-b1cd137699e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:39.266860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981631c-a601-4754-bc8e-b1cd137699e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:39.267138 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981631c-a601-4754-bc8e-b1cd137699e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:39.267403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981631c-a601-4754-bc8e-b1cd137699e1 admin admin] PATH_INFO: `/v3/projects/1c3a670c03d64fb49bc0a6c63701776b/users/18af9ca655334c329550797c6813bc1d/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:39.285099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981631c-a601-4754-bc8e-b1cd137699e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3a670c03d64fb49bc0a6c63701776b, user_id=18af9ca655334c329550797c6813bc1d, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:39.288562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981631c-a601-4754-bc8e-b1cd137699e1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:39.297180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:39.305406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1314/2629] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:39 2022] PUT /identity/v3/projects/1c3a670c03d64fb49bc0a6c63701776b/users/18af9ca655334c329550797c6813bc1d/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:39.309180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e489a60-6927-431f-8000-ce4e50da88ad admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:39.319741 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e489a60-6927-431f-8000-ce4e50da88ad admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:39.376687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d08111-3612-4a94-a36f-447ceeae386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:39.377301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d08111-3612-4a94-a36f-447ceeae386a admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:39.377580 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d08111-3612-4a94-a36f-447ceeae386a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:39.377849 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d08111-3612-4a94-a36f-447ceeae386a admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:39.378482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d08111-3612-4a94-a36f-447ceeae386a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:39.380068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d08111-3612-4a94-a36f-447ceeae386a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:39.390019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1316/2630] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:27:39.394189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981631c-a601-4754-bc8e-b1cd137699e1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:39.406051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981631c-a601-4754-bc8e-b1cd137699e1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:39.410846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fb0e3-233e-40f6-b801-eea1035c56b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:39.412109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb0e3-233e-40f6-b801-eea1035c56b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:39.412524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb0e3-233e-40f6-b801-eea1035c56b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:39.413010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb0e3-233e-40f6-b801-eea1035c56b6 admin admin] PATH_INFO: `/v3/projects/1c3a670c03d64fb49bc0a6c63701776b/users/18af9ca655334c329550797c6813bc1d/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:39.414994 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fb0e3-233e-40f6-b801-eea1035c56b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3a670c03d64fb49bc0a6c63701776b, user_id=18af9ca655334c329550797c6813bc1d, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:39.417709 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fb0e3-233e-40f6-b801-eea1035c56b6 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:39.433721 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1315/2631] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:39 2022] PUT /identity/v3/projects/1c3a670c03d64fb49bc0a6c63701776b/users/18af9ca655334c329550797c6813bc1d/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:39.444334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e8aa-e9e6-40d4-8f9e-61adbd6d339f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:39.444716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e8aa-e9e6-40d4-8f9e-61adbd6d339f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:39.444994 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e8aa-e9e6-40d4-8f9e-61adbd6d339f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:39.512742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5b06e8aa-e9e6-40d4-8f9e-61adbd6d339f None None] MFA Rules not processed for user `18af9ca655334c329550797c6813bc1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:39.514323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5b06e8aa-e9e6-40d4-8f9e-61adbd6d339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:39.568026 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:39.620504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1317/2632] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:27:39.631921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fb0e3-233e-40f6-b801-eea1035c56b6 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:39.633609 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a43fb0e3-233e-40f6-b801-eea1035c56b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:39.691567 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fb0e3-233e-40f6-b801-eea1035c56b6 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:39.695316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3d7c0-3960-4fed-837f-8bc165240954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:39.695914 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3d7c0-3960-4fed-837f-8bc165240954 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:39.696189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3d7c0-3960-4fed-837f-8bc165240954 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:39.696456 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3d7c0-3960-4fed-837f-8bc165240954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:39.770051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3d7c0-3960-4fed-837f-8bc165240954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:39.773766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3d7c0-3960-4fed-837f-8bc165240954 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:39.785523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1316/2633] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:41.381612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e8aa-e9e6-40d4-8f9e-61adbd6d339f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:41.383151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5b06e8aa-e9e6-40d4-8f9e-61adbd6d339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:41.395758 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e8aa-e9e6-40d4-8f9e-61adbd6d339f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:41.405299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d17db-6931-4d14-a24d-68b5da303234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:41.406014 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d17db-6931-4d14-a24d-68b5da303234 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:41.406299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d17db-6931-4d14-a24d-68b5da303234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:41.406582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d17db-6931-4d14-a24d-68b5da303234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:41.514835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d17db-6931-4d14-a24d-68b5da303234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:41.520050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d17db-6931-4d14-a24d-68b5da303234 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:41.531822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1318/2634] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:42.126248 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3d7c0-3960-4fed-837f-8bc165240954 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:42.135805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3d7c0-3960-4fed-837f-8bc165240954 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:42.139506 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb413b2-04e2-4161-827d-2fe845b7493a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:42.140113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb413b2-04e2-4161-827d-2fe845b7493a service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:42.140390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb413b2-04e2-4161-827d-2fe845b7493a service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:42.140689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb413b2-04e2-4161-827d-2fe845b7493a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:42.151006 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb413b2-04e2-4161-827d-2fe845b7493a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:42.152434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb413b2-04e2-4161-827d-2fe845b7493a service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:42.163603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1317/2635] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:46.145582 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d17db-6931-4d14-a24d-68b5da303234 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:46.218362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d17db-6931-4d14-a24d-68b5da303234 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:46.223632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:46.224374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:46.224744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:46.225721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] PATH_INFO: `/v3/users/22ef4ca54ccd443a8e4fd96851ef98fc` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:46.226941 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ef4ca54ccd443a8e4fd96851ef98fc)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:46.229160 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:46.281243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ef4ca54ccd443a8e4fd96851ef98fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:46.290256 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ef4ca54ccd443a8e4fd96851ef98fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:46.290922 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ef4ca54ccd443a8e4fd96851ef98fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:46.291550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ef4ca54ccd443a8e4fd96851ef98fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:46.300373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ef4ca54ccd443a8e4fd96851ef98fc'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:46.310677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:46.322853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1319/2636] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:46 2022] DELETE /identity/v3/users/22ef4ca54ccd443a8e4fd96851ef98fc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:46.329704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1ff2-ddb3-4f9e-a885-ff2ccc51d022 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:46.330217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1ff2-ddb3-4f9e-a885-ff2ccc51d022 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:46.330217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1ff2-ddb3-4f9e-a885-ff2ccc51d022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:46.349922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-06ed1ff2-ddb3-4f9e-a885-ff2ccc51d022 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:46.351775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-06ed1ff2-ddb3-4f9e-a885-ff2ccc51d022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:46.411117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1318/2637] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:27:46.422032 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:46.424012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:46.481027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f5a71-a413-46d9-9749-cab4195ef0db admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:46.484577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4814263-e661-4093-9718-da5f908e38c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:46.485208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4814263-e661-4093-9718-da5f908e38c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:46.485480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4814263-e661-4093-9718-da5f908e38c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:46.485744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4814263-e661-4093-9718-da5f908e38c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:46.495242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4814263-e661-4093-9718-da5f908e38c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:46.496946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4814263-e661-4093-9718-da5f908e38c7 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:46.507357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1320/2638] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:46.874413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1ff2-ddb3-4f9e-a885-ff2ccc51d022 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:46.875896 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-06ed1ff2-ddb3-4f9e-a885-ff2ccc51d022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:46.889016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1ff2-ddb3-4f9e-a885-ff2ccc51d022 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:46.893832 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:46.894467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:46.894742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:46.895008 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] PATH_INFO: `/v3/projects/7062239e6afd4a208e77706d7435eaa8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:46.896117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7062239e6afd4a208e77706d7435eaa8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:46.898687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:46.922188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:46.947247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7062239e6afd4a208e77706d7435eaa8', 'request_id': 'req-31b072e3-97cd-45fa-b8d3-60bfac765b67'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:46.952633 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7062239e6afd4a208e77706d7435eaa8', 'request_id': 'req-31b072e3-97cd-45fa-b8d3-60bfac765b67'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:46.960468 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7062239e6afd4a208e77706d7435eaa8', 'request_id': 'req-31b072e3-97cd-45fa-b8d3-60bfac765b67'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:46.971541 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] The token cache is being invalidate because project 7062239e6afd4a208e77706d7435eaa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:46.971823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:46.972452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:46.974028 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1319/2639] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:46 2022] DELETE /identity/v3/projects/7062239e6afd4a208e77706d7435eaa8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:46.977895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4814263-e661-4093-9718-da5f908e38c7 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:46.994636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4814263-e661-4093-9718-da5f908e38c7 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:47.059167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:47.059683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:47.059961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:47.060231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] PATH_INFO: `/v3/users/ce8496c105ae4133903ffcd8bfa8dcb9` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:47.061387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8496c105ae4133903ffcd8bfa8dcb9)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:47.063306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:47.120352 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8496c105ae4133903ffcd8bfa8dcb9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.128674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8496c105ae4133903ffcd8bfa8dcb9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.129825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8496c105ae4133903ffcd8bfa8dcb9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.130530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8496c105ae4133903ffcd8bfa8dcb9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.138955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8496c105ae4133903ffcd8bfa8dcb9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.158756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1321/2640] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:46 2022] DELETE /identity/v3/users/ce8496c105ae4133903ffcd8bfa8dcb9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:47.483939 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:47.485532 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:47.502144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b072e3-97cd-45fa-b8d3-60bfac765b67 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:47.565549 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:47.566182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:47.566461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:47.566730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] PATH_INFO: `/v3/projects/77aef4d244af463f96746319c2c75c2e` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:47.567835 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77aef4d244af463f96746319c2c75c2e)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:47.570524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:47.615794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77aef4d244af463f96746319c2c75c2e', 'request_id': 'req-06f5be89-0a91-4ebf-95d7-29275279f6a8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.621562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77aef4d244af463f96746319c2c75c2e', 'request_id': 'req-06f5be89-0a91-4ebf-95d7-29275279f6a8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.628521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77aef4d244af463f96746319c2c75c2e', 'request_id': 'req-06f5be89-0a91-4ebf-95d7-29275279f6a8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.639900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] The token cache is being invalidate because project 77aef4d244af463f96746319c2c75c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:47.640188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.640833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.642315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1320/2641] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:47 2022] DELETE /identity/v3/projects/77aef4d244af463f96746319c2c75c2e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:47.646230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:47.648390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:47.661672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b4813-8a35-49d9-a7ff-a048b5d18c56 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:47.670291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:47.729293 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:47.729993 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:47.730220 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:47.730525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] PATH_INFO: `/v3/users/18af9ca655334c329550797c6813bc1d` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:47.731918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18af9ca655334c329550797c6813bc1d)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:47.734062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:47.786620 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18af9ca655334c329550797c6813bc1d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.798339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18af9ca655334c329550797c6813bc1d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.799664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18af9ca655334c329550797c6813bc1d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.800497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18af9ca655334c329550797c6813bc1d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.813520 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-50f006fb-cc3f-4223-8539-a0ee16ea2541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18af9ca655334c329550797c6813bc1d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:47.839533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1322/2642] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:47 2022] DELETE /identity/v3/users/18af9ca655334c329550797c6813bc1d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:48.153032 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:48.154461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:48.170141 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5be89-0a91-4ebf-95d7-29275279f6a8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:48.224482 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:48.250899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:48.251539 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:48.252081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:48.252508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] PATH_INFO: `/v3/projects/1c3a670c03d64fb49bc0a6c63701776b` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:48.253760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3a670c03d64fb49bc0a6c63701776b)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:48.255642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:48.311267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3a670c03d64fb49bc0a6c63701776b', 'request_id': 'req-eaeffb04-a602-4e97-8136-83f1bd56a748'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:48.316971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3a670c03d64fb49bc0a6c63701776b', 'request_id': 'req-eaeffb04-a602-4e97-8136-83f1bd56a748'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:48.325711 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3a670c03d64fb49bc0a6c63701776b', 'request_id': 'req-eaeffb04-a602-4e97-8136-83f1bd56a748'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:48.338523 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] The token cache is being invalidate because project 1c3a670c03d64fb49bc0a6c63701776b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:48.338808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:48.339446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eaeffb04-a602-4e97-8136-83f1bd56a748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:48.340967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1321/2643] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:48 2022] DELETE /identity/v3/projects/1c3a670c03d64fb49bc0a6c63701776b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:48.345846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2f7a-334a-4880-9587-7b9fdff669ee None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:48.346346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2f7a-334a-4880-9587-7b9fdff669ee None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:48.346460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2f7a-334a-4880-9587-7b9fdff669ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:48.373700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-15aa2f7a-334a-4880-9587-7b9fdff669ee None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:48.375100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-15aa2f7a-334a-4880-9587-7b9fdff669ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:48.435710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1323/2644] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:48.499578 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae23247-6324-4bc6-bcb1-ff7d82ed36ab None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:48.500199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae23247-6324-4bc6-bcb1-ff7d82ed36ab None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:48.500199 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae23247-6324-4bc6-bcb1-ff7d82ed36ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:48.519780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-fae23247-6324-4bc6-bcb1-ff7d82ed36ab None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:48.521026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fae23247-6324-4bc6-bcb1-ff7d82ed36ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:48.530087 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1322/2645] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:48.534677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2f7a-334a-4880-9587-7b9fdff669ee None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:48.545807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2f7a-334a-4880-9587-7b9fdff669ee None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:48.550818 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60568888-f2a1-4a25-8b09-34c341308759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:48.551479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60568888-f2a1-4a25-8b09-34c341308759 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:48.551818 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60568888-f2a1-4a25-8b09-34c341308759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:48.552088 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60568888-f2a1-4a25-8b09-34c341308759 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:48.552748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60568888-f2a1-4a25-8b09-34c341308759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:27:48.553050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60568888-f2a1-4a25-8b09-34c341308759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:48.555835 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60568888-f2a1-4a25-8b09-34c341308759 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:48.568166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1324/2646] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:27:48.573055 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae23247-6324-4bc6-bcb1-ff7d82ed36ab None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:48.582100 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae23247-6324-4bc6-bcb1-ff7d82ed36ab None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:48.587364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36924221-aab2-4bfb-90d8-279c6025f299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:48.587952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36924221-aab2-4bfb-90d8-279c6025f299 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:48.588223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36924221-aab2-4bfb-90d8-279c6025f299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:48.588486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36924221-aab2-4bfb-90d8-279c6025f299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:48.589158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36924221-aab2-4bfb-90d8-279c6025f299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:48.591031 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36924221-aab2-4bfb-90d8-279c6025f299 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:48.619850 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1323/2647] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:48 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:27:48.623636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60568888-f2a1-4a25-8b09-34c341308759 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:48.634040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60568888-f2a1-4a25-8b09-34c341308759 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:48.651077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:48.693237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec43c-e4d1-4e5d-83c0-d2cdebcd810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:48.694479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec43c-e4d1-4e5d-83c0-d2cdebcd810d admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:48.695019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec43c-e4d1-4e5d-83c0-d2cdebcd810d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:48.695299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec43c-e4d1-4e5d-83c0-d2cdebcd810d admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:48.695926 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec43c-e4d1-4e5d-83c0-d2cdebcd810d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:48.697880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec43c-e4d1-4e5d-83c0-d2cdebcd810d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:48.719072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1325/2648] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:48 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:27:48.723255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36924221-aab2-4bfb-90d8-279c6025f299 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:48.733605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36924221-aab2-4bfb-90d8-279c6025f299 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:48.738129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e820c-2e43-4eec-89e1-7fc7ad227a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:48.738722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e820c-2e43-4eec-89e1-7fc7ad227a62 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:48.738996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e820c-2e43-4eec-89e1-7fc7ad227a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:48.739258 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e820c-2e43-4eec-89e1-7fc7ad227a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:48.739877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e820c-2e43-4eec-89e1-7fc7ad227a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:48.742134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e820c-2e43-4eec-89e1-7fc7ad227a62 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:48.751785 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1324/2649] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:48.755584 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec43c-e4d1-4e5d-83c0-d2cdebcd810d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:48.766435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec43c-e4d1-4e5d-83c0-d2cdebcd810d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:48.771062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6930-81d1-45a8-be17-1a5cc581aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:48.771665 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6930-81d1-45a8-be17-1a5cc581aec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:48.771955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6930-81d1-45a8-be17-1a5cc581aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:48.772453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6930-81d1-45a8-be17-1a5cc581aec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:48.773166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6930-81d1-45a8-be17-1a5cc581aec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:48.774740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6930-81d1-45a8-be17-1a5cc581aec6 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:48.785138 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1326/2650] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:27:48.789064 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e820c-2e43-4eec-89e1-7fc7ad227a62 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:48.799844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e820c-2e43-4eec-89e1-7fc7ad227a62 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:48.805140 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a9693-055f-489a-a355-97e5aeb42769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:48.805798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a9693-055f-489a-a355-97e5aeb42769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:48.806068 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a9693-055f-489a-a355-97e5aeb42769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:48.806331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a9693-055f-489a-a355-97e5aeb42769 admin admin] PATH_INFO: `/v3/projects/d9d27338450640b4a9ea3cc472e1e9e2/users/0f0a0f0738a64830bd44f66b7eb7f27c/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:48.821194 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a9693-055f-489a-a355-97e5aeb42769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d27338450640b4a9ea3cc472e1e9e2, user_id=0f0a0f0738a64830bd44f66b7eb7f27c, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:48.823822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a9693-055f-489a-a355-97e5aeb42769 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:48.836659 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1325/2651] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:48 2022] PUT /identity/v3/projects/d9d27338450640b4a9ea3cc472e1e9e2/users/0f0a0f0738a64830bd44f66b7eb7f27c/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:48.847170 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb1a05-7a19-4c53-8007-b99a914a0806 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:48.847481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb1a05-7a19-4c53-8007-b99a914a0806 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:48.847750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb1a05-7a19-4c53-8007-b99a914a0806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:48.875958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-bffb1a05-7a19-4c53-8007-b99a914a0806 None None] MFA Rules not processed for user `0f0a0f0738a64830bd44f66b7eb7f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:48.877186 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bffb1a05-7a19-4c53-8007-b99a914a0806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:48.942777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1327/2652] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:48.948029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a9693-055f-489a-a355-97e5aeb42769 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.009115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a9693-055f-489a-a355-97e5aeb42769 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.013775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf879-073c-434c-9e51-398de2fac8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.014365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf879-073c-434c-9e51-398de2fac8de admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.014639 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf879-073c-434c-9e51-398de2fac8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.014906 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf879-073c-434c-9e51-398de2fac8de admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.015515 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf879-073c-434c-9e51-398de2fac8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.017430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf879-073c-434c-9e51-398de2fac8de admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.028287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:49.045764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1326/2653] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:48 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:49.050109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb1a05-7a19-4c53-8007-b99a914a0806 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.061434 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb1a05-7a19-4c53-8007-b99a914a0806 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.117613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445712c6-7245-40e0-8d1b-88c014f36caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.118221 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445712c6-7245-40e0-8d1b-88c014f36caf admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.118500 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445712c6-7245-40e0-8d1b-88c014f36caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.118817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445712c6-7245-40e0-8d1b-88c014f36caf admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.119440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445712c6-7245-40e0-8d1b-88c014f36caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.121388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445712c6-7245-40e0-8d1b-88c014f36caf admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.142101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1328/2654] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:49 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:49.146069 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf879-073c-434c-9e51-398de2fac8de admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.156678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf879-073c-434c-9e51-398de2fac8de admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.161239 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890de308-c538-4708-8836-906daf71e73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.161823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890de308-c538-4708-8836-906daf71e73c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.162099 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890de308-c538-4708-8836-906daf71e73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.162364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890de308-c538-4708-8836-906daf71e73c admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.163730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890de308-c538-4708-8836-906daf71e73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.165449 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890de308-c538-4708-8836-906daf71e73c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.175536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1327/2655] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:49.179964 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445712c6-7245-40e0-8d1b-88c014f36caf admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.191477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445712c6-7245-40e0-8d1b-88c014f36caf admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.198004 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85d845-4e6c-4460-8e86-0fc86b95851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.198604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85d845-4e6c-4460-8e86-0fc86b95851a admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.198882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85d845-4e6c-4460-8e86-0fc86b95851a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.199150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85d845-4e6c-4460-8e86-0fc86b95851a admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.199783 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85d845-4e6c-4460-8e86-0fc86b95851a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.201472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85d845-4e6c-4460-8e86-0fc86b95851a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.212295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1329/2656] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:49.216444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890de308-c538-4708-8836-906daf71e73c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.226447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890de308-c538-4708-8836-906daf71e73c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.230997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551feee1-bb3e-4e41-a8fc-d949bdd9f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.231632 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551feee1-bb3e-4e41-a8fc-d949bdd9f98c admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.231907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551feee1-bb3e-4e41-a8fc-d949bdd9f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.232174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551feee1-bb3e-4e41-a8fc-d949bdd9f98c admin admin] PATH_INFO: `/v3/projects/c82dbd0c5fd34c6abd3049559c19c7d8/users/0c1966e5b8304f2e81ef29ee02e22fea/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.246910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551feee1-bb3e-4e41-a8fc-d949bdd9f98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82dbd0c5fd34c6abd3049559c19c7d8, user_id=0c1966e5b8304f2e81ef29ee02e22fea, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.249619 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551feee1-bb3e-4e41-a8fc-d949bdd9f98c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.262819 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1328/2657] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:49 2022] PUT /identity/v3/projects/c82dbd0c5fd34c6abd3049559c19c7d8/users/0c1966e5b8304f2e81ef29ee02e22fea/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:49.274730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30b404-0b56-4e00-887a-e82f7c6ebf69 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.275046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30b404-0b56-4e00-887a-e82f7c6ebf69 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.275346 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30b404-0b56-4e00-887a-e82f7c6ebf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.289754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:49.305494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ea30b404-0b56-4e00-887a-e82f7c6ebf69 None None] MFA Rules not processed for user `0c1966e5b8304f2e81ef29ee02e22fea`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:49.306664 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ea30b404-0b56-4e00-887a-e82f7c6ebf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:49.352276 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551feee1-bb3e-4e41-a8fc-d949bdd9f98c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.354038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-551feee1-bb3e-4e41-a8fc-d949bdd9f98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:49.373306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1330/2658] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:49.377703 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30b404-0b56-4e00-887a-e82f7c6ebf69 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.418919 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551feee1-bb3e-4e41-a8fc-d949bdd9f98c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.422692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d98d5-62ba-49a8-913a-815c63d6faf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79efccae1afa46e78c25f617bf2dd9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.423651 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d98d5-62ba-49a8-913a-815c63d6faf2 service glance] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.423937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d98d5-62ba-49a8-913a-815c63d6faf2 service glance] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.424205 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d98d5-62ba-49a8-913a-815c63d6faf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.426057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f23d98d5-62ba-49a8-913a-815c63d6faf2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:49.446817 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30b404-0b56-4e00-887a-e82f7c6ebf69 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.451439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36415a08-071a-4e46-9d9e-cfd5a8b0918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.452058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36415a08-071a-4e46-9d9e-cfd5a8b0918d admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.452333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36415a08-071a-4e46-9d9e-cfd5a8b0918d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.452605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36415a08-071a-4e46-9d9e-cfd5a8b0918d admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.453412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36415a08-071a-4e46-9d9e-cfd5a8b0918d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.455313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36415a08-071a-4e46-9d9e-cfd5a8b0918d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.485972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1331/2659] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:27:49 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:49.485972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36415a08-071a-4e46-9d9e-cfd5a8b0918d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.485972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-36415a08-071a-4e46-9d9e-cfd5a8b0918d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:49.489337 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d98d5-62ba-49a8-913a-815c63d6faf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.491442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d98d5-62ba-49a8-913a-815c63d6faf2 service glance] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.501381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1329/2660] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:27:49.504167 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d98d5-62ba-49a8-913a-815c63d6faf2 service glance] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.515485 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d98d5-62ba-49a8-913a-815c63d6faf2 service glance] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.565304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36415a08-071a-4e46-9d9e-cfd5a8b0918d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.571880 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1ff49-7f1a-4407-929c-2ba5444484db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.572492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1ff49-7f1a-4407-929c-2ba5444484db service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.572805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1ff49-7f1a-4407-929c-2ba5444484db service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.573077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1ff49-7f1a-4407-929c-2ba5444484db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.577535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22714-2812-46f3-871b-6c1849a0bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.578138 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22714-2812-46f3-871b-6c1849a0bd9e admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.578415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22714-2812-46f3-871b-6c1849a0bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.578688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22714-2812-46f3-871b-6c1849a0bd9e admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.579305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a22714-2812-46f3-871b-6c1849a0bd9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.581261 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a22714-2812-46f3-871b-6c1849a0bd9e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.599188 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:49.602155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:49.611897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1330/2661] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:27:49 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:27:49.611897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa7fc-e63a-426f-bdc4-8beeda99fc4b None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.611897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa7fc-e63a-426f-bdc4-8beeda99fc4b None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.611897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa7fc-e63a-426f-bdc4-8beeda99fc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.632864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2b5fa7fc-e63a-426f-bdc4-8beeda99fc4b None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:49.634391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2b5fa7fc-e63a-426f-bdc4-8beeda99fc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:49.649488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1ff49-7f1a-4407-929c-2ba5444484db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.651117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1ff49-7f1a-4407-929c-2ba5444484db service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.661632 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1332/2662] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:49.662677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1ff49-7f1a-4407-929c-2ba5444484db service nova] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.676217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1ff49-7f1a-4407-929c-2ba5444484db service nova] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.683129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5772589-f29d-4194-a846-ca8fce254d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.684398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772589-f29d-4194-a846-ca8fce254d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.684710 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772589-f29d-4194-a846-ca8fce254d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.684987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772589-f29d-4194-a846-ca8fce254d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.685640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5772589-f29d-4194-a846-ca8fce254d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.689433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5772589-f29d-4194-a846-ca8fce254d8b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.704230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1333/2663] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:27:49.704668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1331/2664] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 9 12:27:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:49.708288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5772589-f29d-4194-a846-ca8fce254d8b admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.718280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fa7fc-e63a-426f-bdc4-8beeda99fc4b None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.719538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5772589-f29d-4194-a846-ca8fce254d8b admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.720211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2b5fa7fc-e63a-426f-bdc4-8beeda99fc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:49.725535 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31e24a-9217-4213-a3eb-bec2798d3680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.726530 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31e24a-9217-4213-a3eb-bec2798d3680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.726816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31e24a-9217-4213-a3eb-bec2798d3680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.727090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31e24a-9217-4213-a3eb-bec2798d3680 admin admin] PATH_INFO: `/v3/projects/a454c23bc1114673a56d1d1c974aefe0/users/964986c81913465fb4b35e1f95aa045d/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.756918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31e24a-9217-4213-a3eb-bec2798d3680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a454c23bc1114673a56d1d1c974aefe0, user_id=964986c81913465fb4b35e1f95aa045d, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.760067 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31e24a-9217-4213-a3eb-bec2798d3680 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.784465 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1334/2665] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:49 2022] PUT /identity/v3/projects/a454c23bc1114673a56d1d1c974aefe0/users/964986c81913465fb4b35e1f95aa045d/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:49.785850 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31e24a-9217-4213-a3eb-bec2798d3680 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.830798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fa7fc-e63a-426f-bdc4-8beeda99fc4b None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.880871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31e24a-9217-4213-a3eb-bec2798d3680 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.882234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094841a-e74b-4764-8db6-66592acdd492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.883214 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094841a-e74b-4764-8db6-66592acdd492 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.883498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094841a-e74b-4764-8db6-66592acdd492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.884669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094841a-e74b-4764-8db6-66592acdd492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.885314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094841a-e74b-4764-8db6-66592acdd492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.887355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094841a-e74b-4764-8db6-66592acdd492 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.900048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1335/2666] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:27:49.904408 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094841a-e74b-4764-8db6-66592acdd492 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.908327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685756eb-f3a2-4c56-8abb-c7c806e9083f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.908963 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685756eb-f3a2-4c56-8abb-c7c806e9083f service swift] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.909236 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685756eb-f3a2-4c56-8abb-c7c806e9083f service swift] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.909503 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685756eb-f3a2-4c56-8abb-c7c806e9083f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.915959 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094841a-e74b-4764-8db6-66592acdd492 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.921712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1adc78-dc5c-4432-818c-107e6176f607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.922440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1adc78-dc5c-4432-818c-107e6176f607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.923050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1adc78-dc5c-4432-818c-107e6176f607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.923394 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1adc78-dc5c-4432-818c-107e6176f607 admin admin] PATH_INFO: `/v3/projects/a454c23bc1114673a56d1d1c974aefe0/users/964986c81913465fb4b35e1f95aa045d/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.925512 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1adc78-dc5c-4432-818c-107e6176f607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a454c23bc1114673a56d1d1c974aefe0, user_id=964986c81913465fb4b35e1f95aa045d, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.928431 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1adc78-dc5c-4432-818c-107e6176f607 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.939634 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1336/2667] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:27:49 2022] PUT /identity/v3/projects/a454c23bc1114673a56d1d1c974aefe0/users/964986c81913465fb4b35e1f95aa045d/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:49.950421 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cca04-e092-45e5-baac-8e8169e82aa6 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.950708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cca04-e092-45e5-baac-8e8169e82aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.950980 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cca04-e092-45e5-baac-8e8169e82aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.964616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:49.976206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685756eb-f3a2-4c56-8abb-c7c806e9083f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.977840 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685756eb-f3a2-4c56-8abb-c7c806e9083f service swift] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.983806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ae0cca04-e092-45e5-baac-8e8169e82aa6 None None] MFA Rules not processed for user `964986c81913465fb4b35e1f95aa045d`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:49.985336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ae0cca04-e092-45e5-baac-8e8169e82aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:49.986605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1332/2668] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:27:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 12:27:50.049100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:50.073935 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1337/2669] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:27:50.085221 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685756eb-f3a2-4c56-8abb-c7c806e9083f service swift] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:50.086633 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-685756eb-f3a2-4c56-8abb-c7c806e9083f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:50.149949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685756eb-f3a2-4c56-8abb-c7c806e9083f service swift] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:50.200587 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437bf54-2722-4977-95d7-2c3aa107dd0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:50.201219 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437bf54-2722-4977-95d7-2c3aa107dd0c service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:50.201514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437bf54-2722-4977-95d7-2c3aa107dd0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:50.201781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437bf54-2722-4977-95d7-2c3aa107dd0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:50.260227 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437bf54-2722-4977-95d7-2c3aa107dd0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:50.261693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437bf54-2722-4977-95d7-2c3aa107dd0c service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:50.272246 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1333/2670] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:51.783768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cca04-e092-45e5-baac-8e8169e82aa6 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:51.785232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ae0cca04-e092-45e5-baac-8e8169e82aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:51.797114 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cca04-e092-45e5-baac-8e8169e82aa6 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:51.800957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747acfdd-bbac-403b-81b4-328190bdb670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:51.801550 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747acfdd-bbac-403b-81b4-328190bdb670 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:51.801846 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747acfdd-bbac-403b-81b4-328190bdb670 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:51.802117 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747acfdd-bbac-403b-81b4-328190bdb670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:51.859702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747acfdd-bbac-403b-81b4-328190bdb670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:51.861231 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747acfdd-bbac-403b-81b4-328190bdb670 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:51.870874 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1338/2671] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:52.403325 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437bf54-2722-4977-95d7-2c3aa107dd0c service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:52.411935 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437bf54-2722-4977-95d7-2c3aa107dd0c service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:52.416777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19239d0-c23a-4216-9787-5db03d69fa9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:52.417372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19239d0-c23a-4216-9787-5db03d69fa9b service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:52.417642 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19239d0-c23a-4216-9787-5db03d69fa9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:52.417925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19239d0-c23a-4216-9787-5db03d69fa9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:52.427557 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19239d0-c23a-4216-9787-5db03d69fa9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:52.429085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19239d0-c23a-4216-9787-5db03d69fa9b service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:52.439079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1334/2672] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:56.297979 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747acfdd-bbac-403b-81b4-328190bdb670 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:56.359414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747acfdd-bbac-403b-81b4-328190bdb670 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:56.363944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:56.364560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:56.364864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:56.365132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] PATH_INFO: `/v3/users/0f0a0f0738a64830bd44f66b7eb7f27c` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:56.366825 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f0a0f0738a64830bd44f66b7eb7f27c)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:56.368820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:56.414075 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f0a0f0738a64830bd44f66b7eb7f27c'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:56.421174 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f0a0f0738a64830bd44f66b7eb7f27c'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:56.421797 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f0a0f0738a64830bd44f66b7eb7f27c'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:56.423084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f0a0f0738a64830bd44f66b7eb7f27c'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:56.430237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f0a0f0738a64830bd44f66b7eb7f27c'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:56.447888 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1339/2673] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:56 2022] DELETE /identity/v3/users/0f0a0f0738a64830bd44f66b7eb7f27c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:56.452377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003191-904c-4f55-9609-aab358d2221c None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:56.452884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003191-904c-4f55-9609-aab358d2221c None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:56.452986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003191-904c-4f55-9609-aab358d2221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:56.471579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-6a003191-904c-4f55-9609-aab358d2221c None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:56.472812 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6a003191-904c-4f55-9609-aab358d2221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:56.514678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:56.532130 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1335/2674] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:56.542417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:56.543822 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:56.555376 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:56.605653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1d10a-84b1-4834-aea8-3abec1395658 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:56.609284 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4ecc6-914b-4906-a567-8a8bca16925f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:56.609892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4ecc6-914b-4906-a567-8a8bca16925f service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:56.610165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4ecc6-914b-4906-a567-8a8bca16925f service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:56.610432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4ecc6-914b-4906-a567-8a8bca16925f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:56.620661 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4ecc6-914b-4906-a567-8a8bca16925f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:56.622108 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4ecc6-914b-4906-a567-8a8bca16925f service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:56.631606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1340/2675] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:56.898719 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a003191-904c-4f55-9609-aab358d2221c None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:56.900220 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-6a003191-904c-4f55-9609-aab358d2221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:56.912975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a003191-904c-4f55-9609-aab358d2221c None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:56.917683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:56.918326 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:56.918627 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:56.918952 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] PATH_INFO: `/v3/projects/d9d27338450640b4a9ea3cc472e1e9e2` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:56.920092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d27338450640b4a9ea3cc472e1e9e2)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:56.922034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:56.970177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d27338450640b4a9ea3cc472e1e9e2', 'request_id': 'req-47dc17d3-2357-438c-b4c1-112eb4aeb65a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:56.977316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d27338450640b4a9ea3cc472e1e9e2', 'request_id': 'req-47dc17d3-2357-438c-b4c1-112eb4aeb65a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:56.985846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d27338450640b4a9ea3cc472e1e9e2', 'request_id': 'req-47dc17d3-2357-438c-b4c1-112eb4aeb65a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:56.997305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] The token cache is being invalidate because project d9d27338450640b4a9ea3cc472e1e9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:56.997641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:56.998335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:56.999815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1336/2676] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:56 2022] DELETE /identity/v3/projects/d9d27338450640b4a9ea3cc472e1e9e2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:57.003826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4ecc6-914b-4906-a567-8a8bca16925f service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:57.013972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4ecc6-914b-4906-a567-8a8bca16925f service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:57.072708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:57.073342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:57.073637 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:57.073891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] PATH_INFO: `/v3/users/0c1966e5b8304f2e81ef29ee02e22fea` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:57.075006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1966e5b8304f2e81ef29ee02e22fea)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:57.076944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:57.122229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1966e5b8304f2e81ef29ee02e22fea'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.129251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1966e5b8304f2e81ef29ee02e22fea'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.129869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1966e5b8304f2e81ef29ee02e22fea'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.130476 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1966e5b8304f2e81ef29ee02e22fea'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.138025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1966e5b8304f2e81ef29ee02e22fea'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.154883 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1341/2677] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:57 2022] DELETE /identity/v3/users/0c1966e5b8304f2e81ef29ee02e22fea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:57.441843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:57.443356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:57.456967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc17d3-2357-438c-b4c1-112eb4aeb65a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:57.514955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:57.515572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:57.515843 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:57.516107 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] PATH_INFO: `/v3/projects/c82dbd0c5fd34c6abd3049559c19c7d8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:57.517225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82dbd0c5fd34c6abd3049559c19c7d8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:57.519131 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:57.564691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82dbd0c5fd34c6abd3049559c19c7d8', 'request_id': 'req-a24c7747-d541-4af9-8172-5c12f3de85d9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.570272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82dbd0c5fd34c6abd3049559c19c7d8', 'request_id': 'req-a24c7747-d541-4af9-8172-5c12f3de85d9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.577591 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82dbd0c5fd34c6abd3049559c19c7d8', 'request_id': 'req-a24c7747-d541-4af9-8172-5c12f3de85d9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.585828 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:57.590154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] The token cache is being invalidate because project c82dbd0c5fd34c6abd3049559c19c7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:57.590638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.591441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.593584 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1337/2678] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:57 2022] DELETE /identity/v3/projects/c82dbd0c5fd34c6abd3049559c19c7d8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:27:57.597610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:57.598988 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:57.612179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d213f66-bb78-4733-8b0b-fa4b8603317b admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:57.641892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:57.670498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:57.671122 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:57.671403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:57.671671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] PATH_INFO: `/v3/users/964986c81913465fb4b35e1f95aa045d` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:57.673086 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] RBAC: Authorizing `identity:delete_user(user_id=964986c81913465fb4b35e1f95aa045d)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:57.674999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:57.721027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964986c81913465fb4b35e1f95aa045d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.728788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964986c81913465fb4b35e1f95aa045d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.729507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964986c81913465fb4b35e1f95aa045d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.730143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964986c81913465fb4b35e1f95aa045d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.737165 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964986c81913465fb4b35e1f95aa045d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:57.754702 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1342/2679] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:27:57 2022] DELETE /identity/v3/users/964986c81913465fb4b35e1f95aa045d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:27:58.022521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:58.024043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:58.038462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c7747-d541-4af9-8172-5c12f3de85d9 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:58.098937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:58.099524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:58.100310 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:58.100588 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] PATH_INFO: `/v3/projects/a454c23bc1114673a56d1d1c974aefe0` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:58.101804 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a454c23bc1114673a56d1d1c974aefe0)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:58.103722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:58.152562 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a454c23bc1114673a56d1d1c974aefe0', 'request_id': 'req-a1c10481-fef7-49af-a0e2-e132ad3972af'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:58.158403 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a454c23bc1114673a56d1d1c974aefe0', 'request_id': 'req-a1c10481-fef7-49af-a0e2-e132ad3972af'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:58.167406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a454c23bc1114673a56d1d1c974aefe0', 'request_id': 'req-a1c10481-fef7-49af-a0e2-e132ad3972af'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:58.179521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] The token cache is being invalidate because project a454c23bc1114673a56d1d1c974aefe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:27:58.179800 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:58.180434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:27:58.181949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1338/2680] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:27:58 2022] DELETE /identity/v3/projects/a454c23bc1114673a56d1d1c974aefe0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:07.751228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:08.175972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:30.599503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:30.601587 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:30.657360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed77d1-58f8-4176-b177-71b521ff389a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:30.707148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d605f89-c0e1-44cb-8ea7-5b5745482954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:30.707612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d605f89-c0e1-44cb-8ea7-5b5745482954 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:30.707902 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d605f89-c0e1-44cb-8ea7-5b5745482954 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:30.708219 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d605f89-c0e1-44cb-8ea7-5b5745482954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:30.710909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1d605f89-c0e1-44cb-8ea7-5b5745482954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:30.775721 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d605f89-c0e1-44cb-8ea7-5b5745482954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:30.777226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d605f89-c0e1-44cb-8ea7-5b5745482954 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:30.787162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1343/2681] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:34.283857 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:34.285335 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:34.337808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d605f89-c0e1-44cb-8ea7-5b5745482954 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:34.339402 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1d605f89-c0e1-44cb-8ea7-5b5745482954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:34.354469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d605f89-c0e1-44cb-8ea7-5b5745482954 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:34.359356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:34.360028 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c10481-fef7-49af-a0e2-e132ad3972af admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:34.360153 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:34.360432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:34.360869 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] PATH_INFO: `/v3/users/d401f4d03dfc4391af76a99c91eb37e1` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:34.361996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d401f4d03dfc4391af76a99c91eb37e1)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:34.364254 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:34.368937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa9c21-41dd-4d15-bb7d-9eabd700153d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:34.370275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9c21-41dd-4d15-bb7d-9eabd700153d service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:34.370514 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9c21-41dd-4d15-bb7d-9eabd700153d service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:34.371742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9c21-41dd-4d15-bb7d-9eabd700153d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:34.374086 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-55aa9c21-41dd-4d15-bb7d-9eabd700153d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:34.388365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa9c21-41dd-4d15-bb7d-9eabd700153d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:34.390146 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa9c21-41dd-4d15-bb7d-9eabd700153d service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:34.401631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1339/2682] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:34.421350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd401f4d03dfc4391af76a99c91eb37e1'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:34.429776 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd401f4d03dfc4391af76a99c91eb37e1'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:34.430619 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd401f4d03dfc4391af76a99c91eb37e1'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:34.431237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd401f4d03dfc4391af76a99c91eb37e1'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:34.436819 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:34.441196 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29d6e09d-76f9-45b5-92ec-5f464860c2d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd401f4d03dfc4391af76a99c91eb37e1'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:34.461009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1344/2683] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:28:34 2022] DELETE /identity/v3/users/d401f4d03dfc4391af76a99c91eb37e1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:28:34.653715 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa9c21-41dd-4d15-bb7d-9eabd700153d service placement] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:34.668455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa9c21-41dd-4d15-bb7d-9eabd700153d service placement] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:34.726256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:34.727306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:34.727589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:34.727860 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] PATH_INFO: `/v3/projects/cbc3408c12384818b8389e6a0b1224c4` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:34.729014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc3408c12384818b8389e6a0b1224c4)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:34.730888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:34.776058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc3408c12384818b8389e6a0b1224c4', 'request_id': 'req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:34.781461 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc3408c12384818b8389e6a0b1224c4', 'request_id': 'req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:34.789989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc3408c12384818b8389e6a0b1224c4', 'request_id': 'req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:34.801592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] The token cache is being invalidate because project cbc3408c12384818b8389e6a0b1224c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:28:34.801878 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:34.802509 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-bfea84f4-d6ce-492b-ab3a-9e3ee39df7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:34.804268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1340/2684] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:28:34 2022] DELETE /identity/v3/projects/cbc3408c12384818b8389e6a0b1224c4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:34.809182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aba841-6010-4fae-be25-200cece5ee5f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:34.809469 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aba841-6010-4fae-be25-200cece5ee5f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:34.809742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aba841-6010-4fae-be25-200cece5ee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:34.831151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-83aba841-6010-4fae-be25-200cece5ee5f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:34.832359 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-83aba841-6010-4fae-be25-200cece5ee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:34.892714 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1345/2685] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:28:34.902060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b9029-431e-49c5-891f-490a3dac9c08 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:34.902344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b9029-431e-49c5-891f-490a3dac9c08 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:34.902617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b9029-431e-49c5-891f-490a3dac9c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:34.921851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-db2b9029-431e-49c5-891f-490a3dac9c08 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:34.923324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-db2b9029-431e-49c5-891f-490a3dac9c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:34.931346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1341/2686] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:28:34.935538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aba841-6010-4fae-be25-200cece5ee5f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:34.946167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aba841-6010-4fae-be25-200cece5ee5f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:34.950899 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60492c4c-6c80-497b-a10d-a4013b84d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:34.951503 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60492c4c-6c80-497b-a10d-a4013b84d222 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:34.951779 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60492c4c-6c80-497b-a10d-a4013b84d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:34.952419 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60492c4c-6c80-497b-a10d-a4013b84d222 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:34.952722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60492c4c-6c80-497b-a10d-a4013b84d222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:28:34.953002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60492c4c-6c80-497b-a10d-a4013b84d222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:34.954648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60492c4c-6c80-497b-a10d-a4013b84d222 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:34.970879 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1346/2687] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:28:34.972341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b9029-431e-49c5-891f-490a3dac9c08 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:34.982989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b9029-431e-49c5-891f-490a3dac9c08 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:34.987597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a1257-8027-461d-8294-dd21c46c1a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:34.988177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1257-8027-461d-8294-dd21c46c1a82 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:34.988449 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1257-8027-461d-8294-dd21c46c1a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:34.988758 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1257-8027-461d-8294-dd21c46c1a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:34.989370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a1257-8027-461d-8294-dd21c46c1a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:34.991605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a1257-8027-461d-8294-dd21c46c1a82 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:35.002501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:35.019467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1342/2688] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:28:34 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:28:35.024152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60492c4c-6c80-497b-a10d-a4013b84d222 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:35.034181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60492c4c-6c80-497b-a10d-a4013b84d222 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:35.089166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38a3be-bf94-42ec-b0e2-9e31a775116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:35.089766 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a3be-bf94-42ec-b0e2-9e31a775116c admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:35.090043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a3be-bf94-42ec-b0e2-9e31a775116c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:35.090313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a3be-bf94-42ec-b0e2-9e31a775116c admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:35.090918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38a3be-bf94-42ec-b0e2-9e31a775116c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:35.092853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38a3be-bf94-42ec-b0e2-9e31a775116c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:35.113018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1347/2689] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:28:35 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:28:35.117629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a1257-8027-461d-8294-dd21c46c1a82 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:35.128005 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a1257-8027-461d-8294-dd21c46c1a82 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:35.133269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b7e22-c09d-49ba-9f29-aecaf3680faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:35.133853 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b7e22-c09d-49ba-9f29-aecaf3680faa admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:35.134126 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b7e22-c09d-49ba-9f29-aecaf3680faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:35.134388 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b7e22-c09d-49ba-9f29-aecaf3680faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:35.135128 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b7e22-c09d-49ba-9f29-aecaf3680faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:35.136750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b7e22-c09d-49ba-9f29-aecaf3680faa admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:35.146663 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1343/2690] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:28:35.150595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38a3be-bf94-42ec-b0e2-9e31a775116c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:35.160560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38a3be-bf94-42ec-b0e2-9e31a775116c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:35.165274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812e44-af4d-41fd-82b1-2f93689c53f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:35.165884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812e44-af4d-41fd-82b1-2f93689c53f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:35.166154 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812e44-af4d-41fd-82b1-2f93689c53f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:35.166418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812e44-af4d-41fd-82b1-2f93689c53f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:35.167044 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812e44-af4d-41fd-82b1-2f93689c53f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:35.168607 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812e44-af4d-41fd-82b1-2f93689c53f5 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:35.179882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1348/2691] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:28:35.183937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b7e22-c09d-49ba-9f29-aecaf3680faa admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:35.196327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b7e22-c09d-49ba-9f29-aecaf3680faa admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:35.201434 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6eac-3e94-4c9d-a61a-0a45ef16c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:35.202092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6eac-3e94-4c9d-a61a-0a45ef16c40e admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:35.202370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6eac-3e94-4c9d-a61a-0a45ef16c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:35.202641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6eac-3e94-4c9d-a61a-0a45ef16c40e admin admin] PATH_INFO: `/v3/projects/37c7e026f9054e5395dfbbff4bcf738c/users/b13f5f69d6da4de3a801b094e0b4110d/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:35.217306 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6eac-3e94-4c9d-a61a-0a45ef16c40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c7e026f9054e5395dfbbff4bcf738c, user_id=b13f5f69d6da4de3a801b094e0b4110d, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:35.219932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6eac-3e94-4c9d-a61a-0a45ef16c40e admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:35.232848 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1344/2692] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:28:35 2022] PUT /identity/v3/projects/37c7e026f9054e5395dfbbff4bcf738c/users/b13f5f69d6da4de3a801b094e0b4110d/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:28:35.243521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc4e60-daa2-4765-b45c-09ff0a442e44 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:35.243806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc4e60-daa2-4765-b45c-09ff0a442e44 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:35.244078 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc4e60-daa2-4765-b45c-09ff0a442e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:35.271291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5ddc4e60-daa2-4765-b45c-09ff0a442e44 None None] MFA Rules not processed for user `b13f5f69d6da4de3a801b094e0b4110d`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:35.272523 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5ddc4e60-daa2-4765-b45c-09ff0a442e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:35.306594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:35.346054 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1349/2693] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:28:35.358240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6eac-3e94-4c9d-a61a-0a45ef16c40e admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:35.360605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-adce6eac-3e94-4c9d-a61a-0a45ef16c40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:35.447003 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6eac-3e94-4c9d-a61a-0a45ef16c40e admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:35.452646 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07fdf2-7f9d-40c6-bc82-3ecded1038d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:35.453264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fdf2-7f9d-40c6-bc82-3ecded1038d3 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:35.453540 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fdf2-7f9d-40c6-bc82-3ecded1038d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:35.453807 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fdf2-7f9d-40c6-bc82-3ecded1038d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:35.462017 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07fdf2-7f9d-40c6-bc82-3ecded1038d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:35.463580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07fdf2-7f9d-40c6-bc82-3ecded1038d3 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:35.472438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1345/2694] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:38.210311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc4e60-daa2-4765-b45c-09ff0a442e44 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:38.286806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc4e60-daa2-4765-b45c-09ff0a442e44 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:38.293027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:38.293027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:38.293027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:38.293390 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] PATH_INFO: `/v3/users/b13f5f69d6da4de3a801b094e0b4110d` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:38.294375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13f5f69d6da4de3a801b094e0b4110d)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:38.296286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:38.348561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13f5f69d6da4de3a801b094e0b4110d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:38.357529 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13f5f69d6da4de3a801b094e0b4110d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:38.358177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13f5f69d6da4de3a801b094e0b4110d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:38.358804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13f5f69d6da4de3a801b094e0b4110d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:38.368449 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13f5f69d6da4de3a801b094e0b4110d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:38.392662 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1350/2695] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:28:38 2022] DELETE /identity/v3/users/b13f5f69d6da4de3a801b094e0b4110d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:38.396596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff2f6-97f4-4bd2-9ead-e7a11d4e7468 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:38.397157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff2f6-97f4-4bd2-9ead-e7a11d4e7468 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:38.397242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff2f6-97f4-4bd2-9ead-e7a11d4e7468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:38.425267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-d4aff2f6-97f4-4bd2-9ead-e7a11d4e7468 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:38.426741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d4aff2f6-97f4-4bd2-9ead-e7a11d4e7468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:38.496786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1346/2696] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:28:38.503685 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:38.507175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:38.571472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4f311-d4fe-4a39-af70-1aead230a1c5 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:38.575665 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10351cc5-b6d8-45cf-b5be-cd6cfe269a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:38.576480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351cc5-b6d8-45cf-b5be-cd6cfe269a3b service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:38.577012 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351cc5-b6d8-45cf-b5be-cd6cfe269a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:38.577637 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351cc5-b6d8-45cf-b5be-cd6cfe269a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:38.587556 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:38.590604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10351cc5-b6d8-45cf-b5be-cd6cfe269a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:38.592164 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10351cc5-b6d8-45cf-b5be-cd6cfe269a3b service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:38.608382 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1351/2697] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:38.904833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aff2f6-97f4-4bd2-9ead-e7a11d4e7468 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:38.906257 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-d4aff2f6-97f4-4bd2-9ead-e7a11d4e7468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:38.919883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aff2f6-97f4-4bd2-9ead-e7a11d4e7468 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:38.925486 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:38.926133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:38.926413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:38.926686 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] PATH_INFO: `/v3/projects/37c7e026f9054e5395dfbbff4bcf738c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:38.927881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c7e026f9054e5395dfbbff4bcf738c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:38.929823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:38.979742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:38.991061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c7e026f9054e5395dfbbff4bcf738c', 'request_id': 'req-d5f2c069-0835-4cdc-9644-dd20770c72a1'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:38.998992 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c7e026f9054e5395dfbbff4bcf738c', 'request_id': 'req-d5f2c069-0835-4cdc-9644-dd20770c72a1'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:39.007175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c7e026f9054e5395dfbbff4bcf738c', 'request_id': 'req-d5f2c069-0835-4cdc-9644-dd20770c72a1'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:39.018754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] The token cache is being invalidate because project 37c7e026f9054e5395dfbbff4bcf738c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:28:39.018997 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:39.019634 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-d5f2c069-0835-4cdc-9644-dd20770c72a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:39.021180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1347/2698] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:28:38 2022] DELETE /identity/v3/projects/37c7e026f9054e5395dfbbff4bcf738c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:39.026285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824214d-2c0e-46c7-862c-1991bf8e48eb None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.026597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824214d-2c0e-46c7-862c-1991bf8e48eb None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.026875 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824214d-2c0e-46c7-862c-1991bf8e48eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.047290 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9824214d-2c0e-46c7-862c-1991bf8e48eb None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:39.048559 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9824214d-2c0e-46c7-862c-1991bf8e48eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:39.110428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1352/2699] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:28:39.118649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662083-0582-4751-bd6e-f2964996837f None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.118931 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662083-0582-4751-bd6e-f2964996837f None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.119208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662083-0582-4751-bd6e-f2964996837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.141224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-36662083-0582-4751-bd6e-f2964996837f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:39.142438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-36662083-0582-4751-bd6e-f2964996837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:39.151827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1348/2700] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:28:39.156080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824214d-2c0e-46c7-862c-1991bf8e48eb None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:39.166716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824214d-2c0e-46c7-862c-1991bf8e48eb None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:39.171435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd236da-470b-40c5-a2e1-f330c3cb8423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:39.172360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd236da-470b-40c5-a2e1-f330c3cb8423 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.172645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd236da-470b-40c5-a2e1-f330c3cb8423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.172925 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd236da-470b-40c5-a2e1-f330c3cb8423 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.173561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd236da-470b-40c5-a2e1-f330c3cb8423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:28:39.174287 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd236da-470b-40c5-a2e1-f330c3cb8423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:39.175424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd236da-470b-40c5-a2e1-f330c3cb8423 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:39.187974 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1353/2701] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:28:39.193507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36662083-0582-4751-bd6e-f2964996837f None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:39.203103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36662083-0582-4751-bd6e-f2964996837f None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:39.207775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03359233-c113-402c-a5ca-f2cee4aa034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:39.208366 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359233-c113-402c-a5ca-f2cee4aa034f admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.208696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359233-c113-402c-a5ca-f2cee4aa034f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.208983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359233-c113-402c-a5ca-f2cee4aa034f admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.209772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03359233-c113-402c-a5ca-f2cee4aa034f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:39.211638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03359233-c113-402c-a5ca-f2cee4aa034f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:39.245072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1349/2702] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:28:39 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:28:39.246247 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd236da-470b-40c5-a2e1-f330c3cb8423 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:39.257460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd236da-470b-40c5-a2e1-f330c3cb8423 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:39.324768 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72423e97-55c8-4dfe-8f68-17c53d288b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:39.325373 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423e97-55c8-4dfe-8f68-17c53d288b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.325692 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423e97-55c8-4dfe-8f68-17c53d288b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.325963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423e97-55c8-4dfe-8f68-17c53d288b94 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.326616 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72423e97-55c8-4dfe-8f68-17c53d288b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:39.328508 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72423e97-55c8-4dfe-8f68-17c53d288b94 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:39.356692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03359233-c113-402c-a5ca-f2cee4aa034f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:39.356864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1354/2703] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:28:39 2022] POST /identity/v3/users => generated 279 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:28:39.369044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03359233-c113-402c-a5ca-f2cee4aa034f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:39.374859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67f4f5-9ee2-48cc-9fcb-68d5fbc86e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:39.375467 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f4f5-9ee2-48cc-9fcb-68d5fbc86e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.375741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f4f5-9ee2-48cc-9fcb-68d5fbc86e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.376035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f4f5-9ee2-48cc-9fcb-68d5fbc86e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.376703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67f4f5-9ee2-48cc-9fcb-68d5fbc86e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:39.378312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67f4f5-9ee2-48cc-9fcb-68d5fbc86e33 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:39.390688 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1350/2704] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:28:39.394807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72423e97-55c8-4dfe-8f68-17c53d288b94 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:39.408668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72423e97-55c8-4dfe-8f68-17c53d288b94 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:39.415681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d2347-7b7e-4e2d-97d5-bfbc45609045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:39.416300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d2347-7b7e-4e2d-97d5-bfbc45609045 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.416642 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d2347-7b7e-4e2d-97d5-bfbc45609045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.416927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d2347-7b7e-4e2d-97d5-bfbc45609045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.418181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d2347-7b7e-4e2d-97d5-bfbc45609045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:39.419965 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d2347-7b7e-4e2d-97d5-bfbc45609045 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:39.434870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1355/2705] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:28:39.438685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67f4f5-9ee2-48cc-9fcb-68d5fbc86e33 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:39.448735 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67f4f5-9ee2-48cc-9fcb-68d5fbc86e33 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:39.454034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1ba0a-bb95-4ddb-b73c-649573c90b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:39.454724 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1ba0a-bb95-4ddb-b73c-649573c90b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.454999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1ba0a-bb95-4ddb-b73c-649573c90b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.455269 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1ba0a-bb95-4ddb-b73c-649573c90b4f admin admin] PATH_INFO: `/v3/projects/7ab7c51a740f4d0b8b011f094d535466/users/f69a05ae723c4d51a645d4f4a1570386/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.470083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1ba0a-bb95-4ddb-b73c-649573c90b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab7c51a740f4d0b8b011f094d535466, user_id=f69a05ae723c4d51a645d4f4a1570386, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:39.472996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1ba0a-bb95-4ddb-b73c-649573c90b4f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:39.486726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1351/2706] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:28:39 2022] PUT /identity/v3/projects/7ab7c51a740f4d0b8b011f094d535466/users/f69a05ae723c4d51a645d4f4a1570386/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:39.498912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81712c0e-46e1-418f-bb81-53009942ebcc None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.499194 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81712c0e-46e1-418f-bb81-53009942ebcc None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.499467 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81712c0e-46e1-418f-bb81-53009942ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.664418 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-81712c0e-46e1-418f-bb81-53009942ebcc None None] MFA Rules not processed for user `f69a05ae723c4d51a645d4f4a1570386`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:39.665675 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-81712c0e-46e1-418f-bb81-53009942ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:39.721118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:39.739680 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1356/2707] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:28:39.744516 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1ba0a-bb95-4ddb-b73c-649573c90b4f admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:39.814661 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1ba0a-bb95-4ddb-b73c-649573c90b4f admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:39.819491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6d28-972f-4949-9605-374cd76aa376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:39.820088 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6d28-972f-4949-9605-374cd76aa376 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.820362 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6d28-972f-4949-9605-374cd76aa376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.820653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6d28-972f-4949-9605-374cd76aa376 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.821283 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6d28-972f-4949-9605-374cd76aa376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:39.823169 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6d28-972f-4949-9605-374cd76aa376 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:39.851932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1352/2708] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:28:39 2022] POST /identity/v3/projects => generated 353 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:28:39.855889 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81712c0e-46e1-418f-bb81-53009942ebcc None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:39.866636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81712c0e-46e1-418f-bb81-53009942ebcc None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:39.923820 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7377f4-2ee4-4408-81e7-e7b9e267f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:39.924424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7377f4-2ee4-4408-81e7-e7b9e267f754 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.924739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7377f4-2ee4-4408-81e7-e7b9e267f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.925010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7377f4-2ee4-4408-81e7-e7b9e267f754 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.925633 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7377f4-2ee4-4408-81e7-e7b9e267f754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:39.927696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7377f4-2ee4-4408-81e7-e7b9e267f754 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:39.951051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1357/2709] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:28:39 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:28:39.955183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6d28-972f-4949-9605-374cd76aa376 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:39.966478 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6d28-972f-4949-9605-374cd76aa376 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:39.971259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8032507-0c85-4d93-929c-8ea7af536f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:39.971865 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8032507-0c85-4d93-929c-8ea7af536f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:39.972142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8032507-0c85-4d93-929c-8ea7af536f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:39.972406 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8032507-0c85-4d93-929c-8ea7af536f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:39.973106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8032507-0c85-4d93-929c-8ea7af536f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:39.974736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8032507-0c85-4d93-929c-8ea7af536f73 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:39.985933 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1353/2710] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:28:39.990111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7377f4-2ee4-4408-81e7-e7b9e267f754 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:40.000301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7377f4-2ee4-4408-81e7-e7b9e267f754 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:40.007863 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd31e8-b50f-4b63-8ee0-9399ae27358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:40.008525 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd31e8-b50f-4b63-8ee0-9399ae27358f admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:40.008837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd31e8-b50f-4b63-8ee0-9399ae27358f admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:40.009094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd31e8-b50f-4b63-8ee0-9399ae27358f admin admin] PATH_INFO: `/v3/projects/0bf0366de91f4e6ca033581553ffd34e/users/d419a0916a504c0dbc6fc49e18c46d4b/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:40.026362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd31e8-b50f-4b63-8ee0-9399ae27358f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf0366de91f4e6ca033581553ffd34e, user_id=d419a0916a504c0dbc6fc49e18c46d4b, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:40.029034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd31e8-b50f-4b63-8ee0-9399ae27358f admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:40.044658 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1358/2711] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:28:39 2022] PUT /identity/v3/projects/0bf0366de91f4e6ca033581553ffd34e/users/d419a0916a504c0dbc6fc49e18c46d4b/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:40.048933 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8032507-0c85-4d93-929c-8ea7af536f73 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:40.060746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8032507-0c85-4d93-929c-8ea7af536f73 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:40.106373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:40.143857 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853a2d-28a3-4a1b-8f8d-8fe9e9cd06fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:40.144765 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853a2d-28a3-4a1b-8f8d-8fe9e9cd06fc admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:40.145046 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853a2d-28a3-4a1b-8f8d-8fe9e9cd06fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:40.145317 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853a2d-28a3-4a1b-8f8d-8fe9e9cd06fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:40.145961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853a2d-28a3-4a1b-8f8d-8fe9e9cd06fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:40.148296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853a2d-28a3-4a1b-8f8d-8fe9e9cd06fc admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:40.159127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1354/2712] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:28:40.163392 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd31e8-b50f-4b63-8ee0-9399ae27358f admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:40.173816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd31e8-b50f-4b63-8ee0-9399ae27358f admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:40.178712 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13050118-d286-4a34-b3c9-ecaee5637a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:40.179370 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13050118-d286-4a34-b3c9-ecaee5637a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:40.179655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13050118-d286-4a34-b3c9-ecaee5637a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:40.179928 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13050118-d286-4a34-b3c9-ecaee5637a07 admin admin] PATH_INFO: `/v3/projects/0bf0366de91f4e6ca033581553ffd34e/users/d419a0916a504c0dbc6fc49e18c46d4b/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:40.181919 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13050118-d286-4a34-b3c9-ecaee5637a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf0366de91f4e6ca033581553ffd34e, user_id=d419a0916a504c0dbc6fc49e18c46d4b, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:40.184606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13050118-d286-4a34-b3c9-ecaee5637a07 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:40.196413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1359/2713] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:28:40 2022] PUT /identity/v3/projects/0bf0366de91f4e6ca033581553ffd34e/users/d419a0916a504c0dbc6fc49e18c46d4b/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:40.206720 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8550e2c-5c25-41d8-8968-8b906c2c0bc5 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:40.206999 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8550e2c-5c25-41d8-8968-8b906c2c0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:40.207270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8550e2c-5c25-41d8-8968-8b906c2c0bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:40.236174 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-a8550e2c-5c25-41d8-8968-8b906c2c0bc5 None None] MFA Rules not processed for user `d419a0916a504c0dbc6fc49e18c46d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:40.237640 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a8550e2c-5c25-41d8-8968-8b906c2c0bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:40.313658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1355/2714] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:40 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:28:40.325515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13050118-d286-4a34-b3c9-ecaee5637a07 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:40.327250 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-13050118-d286-4a34-b3c9-ecaee5637a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:40.383405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13050118-d286-4a34-b3c9-ecaee5637a07 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:40.387563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7ff7d-e588-4fdf-bd4d-8258ffe3697f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:40.388189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7ff7d-e588-4fdf-bd4d-8258ffe3697f service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:40.388485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7ff7d-e588-4fdf-bd4d-8258ffe3697f service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:40.388789 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7ff7d-e588-4fdf-bd4d-8258ffe3697f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:40.397910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7ff7d-e588-4fdf-bd4d-8258ffe3697f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:40.399361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7ff7d-e588-4fdf-bd4d-8258ffe3697f service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:40.409148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1360/2715] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:40.484605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8550e2c-5c25-41d8-8968-8b906c2c0bc5 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:40.495022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8550e2c-5c25-41d8-8968-8b906c2c0bc5 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:40.498598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9cd1-0f14-4aa5-b1ea-41834b8e87c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:40.499186 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9cd1-0f14-4aa5-b1ea-41834b8e87c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:40.499462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9cd1-0f14-4aa5-b1ea-41834b8e87c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:40.499732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9cd1-0f14-4aa5-b1ea-41834b8e87c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:40.556182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9cd1-0f14-4aa5-b1ea-41834b8e87c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:40.557665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9cd1-0f14-4aa5-b1ea-41834b8e87c6 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:40.566435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1356/2716] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:50.404944 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:50.562410 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=75 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:55.403957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7ff7d-e588-4fdf-bd4d-8258ffe3697f service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:55.466208 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7ff7d-e588-4fdf-bd4d-8258ffe3697f service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:55.470690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:55.471310 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:55.471591 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:55.471860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] PATH_INFO: `/v3/users/f69a05ae723c4d51a645d4f4a1570386` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:55.473002 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69a05ae723c4d51a645d4f4a1570386)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:55.475561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:55.519179 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69a05ae723c4d51a645d4f4a1570386'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:55.526972 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69a05ae723c4d51a645d4f4a1570386'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:55.527575 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69a05ae723c4d51a645d4f4a1570386'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:55.528177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69a05ae723c4d51a645d4f4a1570386'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:55.534969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69a05ae723c4d51a645d4f4a1570386'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:55.552444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1361/2717] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:28:55 2022] DELETE /identity/v3/users/f69a05ae723c4d51a645d4f4a1570386 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:55.557409 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20781441-1472-4bb8-9cc7-66489667b1eb None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:55.557950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20781441-1472-4bb8-9cc7-66489667b1eb None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:55.557950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20781441-1472-4bb8-9cc7-66489667b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:55.576340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-20781441-1472-4bb8-9cc7-66489667b1eb None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:55.577610 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-20781441-1472-4bb8-9cc7-66489667b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:55.636124 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1357/2718] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:28:55.646436 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:55.647610 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:55.703585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11db5-b2ef-4869-b3e8-b879fefa4dc9 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:55.707261 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119b95-7980-43ba-9114-e8dfeb663aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:55.708496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119b95-7980-43ba-9114-e8dfeb663aeb service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:55.708811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119b95-7980-43ba-9114-e8dfeb663aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:55.709085 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119b95-7980-43ba-9114-e8dfeb663aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:55.718027 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c119b95-7980-43ba-9114-e8dfeb663aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:55.719447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c119b95-7980-43ba-9114-e8dfeb663aeb service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:55.729963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1362/2719] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:55.994415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20781441-1472-4bb8-9cc7-66489667b1eb None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:55.996040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-20781441-1472-4bb8-9cc7-66489667b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:56.010323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20781441-1472-4bb8-9cc7-66489667b1eb None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:56.015542 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:56.016209 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:56.016606 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:56.016768 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] PATH_INFO: `/v3/projects/7ab7c51a740f4d0b8b011f094d535466` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:56.017943 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab7c51a740f4d0b8b011f094d535466)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:56.019861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:56.065842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab7c51a740f4d0b8b011f094d535466', 'request_id': 'req-043424c8-4271-4518-b08b-d87728290b3a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.071813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab7c51a740f4d0b8b011f094d535466', 'request_id': 'req-043424c8-4271-4518-b08b-d87728290b3a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.079863 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab7c51a740f4d0b8b011f094d535466', 'request_id': 'req-043424c8-4271-4518-b08b-d87728290b3a'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.091149 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] The token cache is being invalidate because project 7ab7c51a740f4d0b8b011f094d535466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:28:56.091432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.092054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.093560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1358/2720] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:28:55 2022] DELETE /identity/v3/projects/7ab7c51a740f4d0b8b011f094d535466 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:56.097490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119b95-7980-43ba-9114-e8dfeb663aeb service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:56.107228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119b95-7980-43ba-9114-e8dfeb663aeb service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:56.125910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:56.166003 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:56.166548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:56.166823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:56.167087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] PATH_INFO: `/v3/users/d419a0916a504c0dbc6fc49e18c46d4b` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:56.168190 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d419a0916a504c0dbc6fc49e18c46d4b)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:56.170187 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:56.218135 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd419a0916a504c0dbc6fc49e18c46d4b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.225653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd419a0916a504c0dbc6fc49e18c46d4b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.226440 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd419a0916a504c0dbc6fc49e18c46d4b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.227043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd419a0916a504c0dbc6fc49e18c46d4b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.233872 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-07997ac0-18f2-413f-9c1a-3a6bcb02d928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd419a0916a504c0dbc6fc49e18c46d4b'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.251175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1363/2721] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:28:56 2022] DELETE /identity/v3/users/d419a0916a504c0dbc6fc49e18c46d4b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:56.520052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:56.521593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:56.534781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043424c8-4271-4518-b08b-d87728290b3a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:56.595813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:56.596504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:56.596722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:56.596988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] PATH_INFO: `/v3/projects/0bf0366de91f4e6ca033581553ffd34e` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:56.598109 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf0366de91f4e6ca033581553ffd34e)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:56.600792 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:56.630165 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:56.648033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf0366de91f4e6ca033581553ffd34e', 'request_id': 'req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.653525 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf0366de91f4e6ca033581553ffd34e', 'request_id': 'req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.660742 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf0366de91f4e6ca033581553ffd34e', 'request_id': 'req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.672756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] The token cache is being invalidate because project 0bf0366de91f4e6ca033581553ffd34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:28:56.672979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.673603 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e68d5f54-3ff0-4ed7-ada0-a27b1fc20716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:28:56.675080 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1359/2722] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:28:56 2022] DELETE /identity/v3/projects/0bf0366de91f4e6ca033581553ffd34e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:28:56.681843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c295e-6af8-4a0f-9619-e5825777e25a None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:56.682358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c295e-6af8-4a0f-9619-e5825777e25a None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:56.682475 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c295e-6af8-4a0f-9619-e5825777e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:56.703333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ef9c295e-6af8-4a0f-9619-e5825777e25a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:56.704533 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ef9c295e-6af8-4a0f-9619-e5825777e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:56.761932 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1364/2723] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:28:56.769961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8b34-fd12-49a4-bb2e-3577bb2913a6 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:56.771451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8b34-fd12-49a4-bb2e-3577bb2913a6 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:56.771737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8b34-fd12-49a4-bb2e-3577bb2913a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:56.794345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-325a8b34-fd12-49a4-bb2e-3577bb2913a6 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:56.795617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-325a8b34-fd12-49a4-bb2e-3577bb2913a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:56.804744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1360/2724] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:28:56.809209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c295e-6af8-4a0f-9619-e5825777e25a None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:56.818970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c295e-6af8-4a0f-9619-e5825777e25a None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:56.823505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ee8c-5c54-48b0-8ba1-c72c1b0b125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:56.824091 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ee8c-5c54-48b0-8ba1-c72c1b0b125e admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:56.824364 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ee8c-5c54-48b0-8ba1-c72c1b0b125e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:56.824646 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ee8c-5c54-48b0-8ba1-c72c1b0b125e admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:56.825295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150ee8c-5c54-48b0-8ba1-c72c1b0b125e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:28:56.825590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150ee8c-5c54-48b0-8ba1-c72c1b0b125e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:56.827173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150ee8c-5c54-48b0-8ba1-c72c1b0b125e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:56.838963 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1365/2725] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:28:56.843148 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a8b34-fd12-49a4-bb2e-3577bb2913a6 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:56.853144 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a8b34-fd12-49a4-bb2e-3577bb2913a6 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:56.857717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08b6c6-c3f4-4f3d-b38a-e557d1db2dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:56.858294 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08b6c6-c3f4-4f3d-b38a-e557d1db2dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:56.858694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08b6c6-c3f4-4f3d-b38a-e557d1db2dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:56.858964 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08b6c6-c3f4-4f3d-b38a-e557d1db2dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:56.859574 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08b6c6-c3f4-4f3d-b38a-e557d1db2dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:56.861508 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08b6c6-c3f4-4f3d-b38a-e557d1db2dc2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:56.888079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1361/2726] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:28:56 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:28:56.892228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ee8c-5c54-48b0-8ba1-c72c1b0b125e admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:56.903111 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ee8c-5c54-48b0-8ba1-c72c1b0b125e admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:56.928951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:56.961301 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db455b8-445f-4210-b5bf-7fd322ba6633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:56.961891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db455b8-445f-4210-b5bf-7fd322ba6633 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:56.962168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db455b8-445f-4210-b5bf-7fd322ba6633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:56.962435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db455b8-445f-4210-b5bf-7fd322ba6633 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:56.963046 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db455b8-445f-4210-b5bf-7fd322ba6633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:56.964976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db455b8-445f-4210-b5bf-7fd322ba6633 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:56.986070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1366/2727] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:28:56 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:28:56.990244 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08b6c6-c3f4-4f3d-b38a-e557d1db2dc2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:57.000366 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08b6c6-c3f4-4f3d-b38a-e557d1db2dc2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:57.005154 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b4d00-501c-47a0-9753-cdf43fd8ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:57.005741 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4d00-501c-47a0-9753-cdf43fd8ecf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:57.006019 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4d00-501c-47a0-9753-cdf43fd8ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:57.006286 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4d00-501c-47a0-9753-cdf43fd8ecf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:57.006917 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b4d00-501c-47a0-9753-cdf43fd8ecf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:57.008499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b4d00-501c-47a0-9753-cdf43fd8ecf0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:57.018371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1362/2728] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:28:57.022487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db455b8-445f-4210-b5bf-7fd322ba6633 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:57.032203 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db455b8-445f-4210-b5bf-7fd322ba6633 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:57.037519 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788d501-58c5-4ca2-a031-71e58e280972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:57.038102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788d501-58c5-4ca2-a031-71e58e280972 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:57.038380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788d501-58c5-4ca2-a031-71e58e280972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:57.038648 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788d501-58c5-4ca2-a031-71e58e280972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:57.039274 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788d501-58c5-4ca2-a031-71e58e280972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:57.040886 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788d501-58c5-4ca2-a031-71e58e280972 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:57.051359 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1367/2729] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:28:57.055377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b4d00-501c-47a0-9753-cdf43fd8ecf0 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:57.065438 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b4d00-501c-47a0-9753-cdf43fd8ecf0 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:57.071413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ffa91-538b-49b3-91b2-5e5a2c77f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:57.072051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ffa91-538b-49b3-91b2-5e5a2c77f4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:57.072329 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ffa91-538b-49b3-91b2-5e5a2c77f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:57.072594 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ffa91-538b-49b3-91b2-5e5a2c77f4f1 admin admin] PATH_INFO: `/v3/projects/d47c0e99784a4da5b2be8f973e85986f/users/c33d934d19e1479cb02f0c035b6c78c7/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:57.087683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ffa91-538b-49b3-91b2-5e5a2c77f4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47c0e99784a4da5b2be8f973e85986f, user_id=c33d934d19e1479cb02f0c035b6c78c7, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:57.090338 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ffa91-538b-49b3-91b2-5e5a2c77f4f1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:57.103645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1363/2730] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:28:57 2022] PUT /identity/v3/projects/d47c0e99784a4da5b2be8f973e85986f/users/c33d934d19e1479cb02f0c035b6c78c7/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:57.108701 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f239-6fe8-44ee-894b-21f68daecff5 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:57.108987 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f239-6fe8-44ee-894b-21f68daecff5 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:57.109257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f239-6fe8-44ee-894b-21f68daecff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:57.127621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-9b25f239-6fe8-44ee-894b-21f68daecff5 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:57.128886 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9b25f239-6fe8-44ee-894b-21f68daecff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:57.195159 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1368/2731] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:28:57.205342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ffa91-538b-49b3-91b2-5e5a2c77f4f1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:57.207067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-405ffa91-538b-49b3-91b2-5e5a2c77f4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:57.267056 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ffa91-538b-49b3-91b2-5e5a2c77f4f1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:57.271798 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d80207-2f82-42f8-9654-ee67aa79a3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:57.272394 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d80207-2f82-42f8-9654-ee67aa79a3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:57.272703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d80207-2f82-42f8-9654-ee67aa79a3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:57.273051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d80207-2f82-42f8-9654-ee67aa79a3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:57.282324 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d80207-2f82-42f8-9654-ee67aa79a3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:57.283733 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d80207-2f82-42f8-9654-ee67aa79a3f1 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:57.293601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1364/2732] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:57.913073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530efc9-40ef-4d67-8125-623eb9c36c5f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:57.913595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530efc9-40ef-4d67-8125-623eb9c36c5f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:57.913595 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530efc9-40ef-4d67-8125-623eb9c36c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:57.941845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4530efc9-40ef-4d67-8125-623eb9c36c5f None None] MFA Rules not processed for user `c33d934d19e1479cb02f0c035b6c78c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:57.943740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4530efc9-40ef-4d67-8125-623eb9c36c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:58.009427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1369/2733] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:28:58.014043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d80207-2f82-42f8-9654-ee67aa79a3f1 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:58.024685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d80207-2f82-42f8-9654-ee67aa79a3f1 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:58.029385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fb647-7237-4f1c-ac3a-4664cc3a9c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:58.030208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb647-7237-4f1c-ac3a-4664cc3a9c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:58.030691 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb647-7237-4f1c-ac3a-4664cc3a9c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:58.031027 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb647-7237-4f1c-ac3a-4664cc3a9c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:58.031658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fb647-7237-4f1c-ac3a-4664cc3a9c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:58.033744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fb647-7237-4f1c-ac3a-4664cc3a9c08 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:58.062057 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1365/2734] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:28:58 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:28:58.066125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530efc9-40ef-4d67-8125-623eb9c36c5f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:58.077183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530efc9-40ef-4d67-8125-623eb9c36c5f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:58.109499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:58.133666 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d099c-3507-4ba6-93a3-f8cf427736b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:58.134262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d099c-3507-4ba6-93a3-f8cf427736b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:58.134539 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d099c-3507-4ba6-93a3-f8cf427736b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:58.134806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d099c-3507-4ba6-93a3-f8cf427736b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:58.135409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d099c-3507-4ba6-93a3-f8cf427736b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:58.137363 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d099c-3507-4ba6-93a3-f8cf427736b2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:58.158211 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1370/2735] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:28:58 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:28:58.162656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fb647-7237-4f1c-ac3a-4664cc3a9c08 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:58.173143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fb647-7237-4f1c-ac3a-4664cc3a9c08 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:58.177693 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588151d1-ca7e-4731-ab5a-78650f31762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:58.178278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588151d1-ca7e-4731-ab5a-78650f31762a admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:58.178553 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588151d1-ca7e-4731-ab5a-78650f31762a admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:58.178821 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588151d1-ca7e-4731-ab5a-78650f31762a admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:58.179448 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588151d1-ca7e-4731-ab5a-78650f31762a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:58.181081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588151d1-ca7e-4731-ab5a-78650f31762a admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:58.191596 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1366/2736] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:28:58.196278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d099c-3507-4ba6-93a3-f8cf427736b2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:58.206369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d099c-3507-4ba6-93a3-f8cf427736b2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:58.211612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e6f4-b7e3-407f-b525-777824104755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:58.212253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e6f4-b7e3-407f-b525-777824104755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:58.212527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e6f4-b7e3-407f-b525-777824104755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:58.212826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e6f4-b7e3-407f-b525-777824104755 admin admin] PATH_INFO: `/v3/projects/a3a42690d78c4c47af697987aed304b6/users/ddf4dc3f59884062985206d571bb4ce4/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:58.227615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76e6f4-b7e3-407f-b525-777824104755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a42690d78c4c47af697987aed304b6, user_id=ddf4dc3f59884062985206d571bb4ce4, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:58.230280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76e6f4-b7e3-407f-b525-777824104755 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:58.242890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1371/2737] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:28:58 2022] PUT /identity/v3/projects/a3a42690d78c4c47af697987aed304b6/users/ddf4dc3f59884062985206d571bb4ce4/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:58.246873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588151d1-ca7e-4731-ab5a-78650f31762a admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:58.257975 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588151d1-ca7e-4731-ab5a-78650f31762a admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:58.274645 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:58.316292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecad7a-7e75-4829-b9d0-42b4c73b12fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:58.316837 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecad7a-7e75-4829-b9d0-42b4c73b12fe admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:58.317656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecad7a-7e75-4829-b9d0-42b4c73b12fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:58.317926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecad7a-7e75-4829-b9d0-42b4c73b12fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:58.318638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecad7a-7e75-4829-b9d0-42b4c73b12fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:58.320223 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecad7a-7e75-4829-b9d0-42b4c73b12fe admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:58.329890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1367/2738] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:28:58.334228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e6f4-b7e3-407f-b525-777824104755 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:58.344514 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e6f4-b7e3-407f-b525-777824104755 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:58.349127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56765547-330d-4950-86ab-08851feae344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:58.349765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56765547-330d-4950-86ab-08851feae344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:58.350042 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56765547-330d-4950-86ab-08851feae344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:58.350311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56765547-330d-4950-86ab-08851feae344 admin admin] PATH_INFO: `/v3/projects/a3a42690d78c4c47af697987aed304b6/users/ddf4dc3f59884062985206d571bb4ce4/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:58.352203 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56765547-330d-4950-86ab-08851feae344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a42690d78c4c47af697987aed304b6, user_id=ddf4dc3f59884062985206d571bb4ce4, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:58.354855 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56765547-330d-4950-86ab-08851feae344 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:58.365362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1372/2739] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:28:58 2022] PUT /identity/v3/projects/a3a42690d78c4c47af697987aed304b6/users/ddf4dc3f59884062985206d571bb4ce4/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:28:58.986413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbadf7-f282-492c-92e7-0ce22b5d3187 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:58.986704 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbadf7-f282-492c-92e7-0ce22b5d3187 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:58.986977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbadf7-f282-492c-92e7-0ce22b5d3187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:59.015743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-93bbadf7-f282-492c-92e7-0ce22b5d3187 None None] MFA Rules not processed for user `ddf4dc3f59884062985206d571bb4ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:59.017051 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-93bbadf7-f282-492c-92e7-0ce22b5d3187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:59.087900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1368/2740] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:28:59.098278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910840e2-0afe-416f-b914-e8b1f45a6e58 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:59.098787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910840e2-0afe-416f-b914-e8b1f45a6e58 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:59.098952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910840e2-0afe-416f-b914-e8b1f45a6e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:59.117814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-910840e2-0afe-416f-b914-e8b1f45a6e58 None None] MFA Rules not processed for user `c33d934d19e1479cb02f0c035b6c78c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:59.119007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-910840e2-0afe-416f-b914-e8b1f45a6e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:59.173756 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1373/2741] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:28:59.186404 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbadf7-f282-492c-92e7-0ce22b5d3187 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:59.187815 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-93bbadf7-f282-492c-92e7-0ce22b5d3187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:59.261698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbadf7-f282-492c-92e7-0ce22b5d3187 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:59.267157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54bb09-227d-4a12-8042-f9cb6dd7f159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:59.267757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54bb09-227d-4a12-8042-f9cb6dd7f159 service nova] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:59.268033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54bb09-227d-4a12-8042-f9cb6dd7f159 service nova] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:59.268305 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54bb09-227d-4a12-8042-f9cb6dd7f159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:59.276106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54bb09-227d-4a12-8042-f9cb6dd7f159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:59.277710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54bb09-227d-4a12-8042-f9cb6dd7f159 service nova] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:59.287079 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1369/2742] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:59.518552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910840e2-0afe-416f-b914-e8b1f45a6e58 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:59.519955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-910840e2-0afe-416f-b914-e8b1f45a6e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:59.577011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910840e2-0afe-416f-b914-e8b1f45a6e58 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:59.580558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f9d4d-6018-4ece-9b4f-b186e5a08ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:59.581183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f9d4d-6018-4ece-9b4f-b186e5a08ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:59.581461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f9d4d-6018-4ece-9b4f-b186e5a08ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:59.581730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f9d4d-6018-4ece-9b4f-b186e5a08ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:59.583441 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-406f9d4d-6018-4ece-9b4f-b186e5a08ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:59.592997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f9d4d-6018-4ece-9b4f-b186e5a08ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:59.594460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f9d4d-6018-4ece-9b4f-b186e5a08ff1 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:59.603010 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1374/2743] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:09.282469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=88 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:09.599518 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:10.143234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54bb09-227d-4a12-8042-f9cb6dd7f159 service nova] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:10.144631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7d54bb09-227d-4a12-8042-f9cb6dd7f159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:10.204451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54bb09-227d-4a12-8042-f9cb6dd7f159 service nova] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:10.208040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18c13-0181-4ae3-9ab2-6b0fb0bf97ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:10.208643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18c13-0181-4ae3-9ab2-6b0fb0bf97ec service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:10.208936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18c13-0181-4ae3-9ab2-6b0fb0bf97ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:10.209207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18c13-0181-4ae3-9ab2-6b0fb0bf97ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:10.218033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba18c13-0181-4ae3-9ab2-6b0fb0bf97ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:10.219472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba18c13-0181-4ae3-9ab2-6b0fb0bf97ec service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:10.229413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1370/2744] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:20.224579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=26 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:29.882030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f9d4d-6018-4ece-9b4f-b186e5a08ff1 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:29.948552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f9d4d-6018-4ece-9b4f-b186e5a08ff1 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:29.953073 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:29.953696 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:29.953971 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:29.954238 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] PATH_INFO: `/v3/users/c33d934d19e1479cb02f0c035b6c78c7` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:29.955361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33d934d19e1479cb02f0c035b6c78c7)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:29.957296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:30.006311 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33d934d19e1479cb02f0c035b6c78c7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.014127 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33d934d19e1479cb02f0c035b6c78c7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.015055 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33d934d19e1479cb02f0c035b6c78c7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.015693 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33d934d19e1479cb02f0c035b6c78c7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.023195 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33d934d19e1479cb02f0c035b6c78c7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.043435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1375/2745] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:29:29 2022] DELETE /identity/v3/users/c33d934d19e1479cb02f0c035b6c78c7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:30.225520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18c13-0181-4ae3-9ab2-6b0fb0bf97ec service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:30.245673 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18c13-0181-4ae3-9ab2-6b0fb0bf97ec service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:30.309886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:30.310320 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:30.310598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:30.310870 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] PATH_INFO: `/v3/projects/d47c0e99784a4da5b2be8f973e85986f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:30.311981 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47c0e99784a4da5b2be8f973e85986f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:30.313899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:30.362153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47c0e99784a4da5b2be8f973e85986f', 'request_id': 'req-a9dd61f8-8adf-4044-ab11-de0597e2fe38'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.368560 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47c0e99784a4da5b2be8f973e85986f', 'request_id': 'req-a9dd61f8-8adf-4044-ab11-de0597e2fe38'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.376407 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47c0e99784a4da5b2be8f973e85986f', 'request_id': 'req-a9dd61f8-8adf-4044-ab11-de0597e2fe38'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.389267 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] The token cache is being invalidate because project d47c0e99784a4da5b2be8f973e85986f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:29:30.389551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.390206 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.391977 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1371/2746] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:29:30 2022] DELETE /identity/v3/projects/d47c0e99784a4da5b2be8f973e85986f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:30.395865 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:30.404918 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:30.421784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c61dbd-b364-406d-a4ea-ee1d6b9a948a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:30.485326 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:30.485976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:30.486257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:30.486527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] PATH_INFO: `/v3/users/ddf4dc3f59884062985206d571bb4ce4` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:30.487700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf4dc3f59884062985206d571bb4ce4)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:30.489731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:30.513410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:30.544665 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf4dc3f59884062985206d571bb4ce4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.552859 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf4dc3f59884062985206d571bb4ce4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.553506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf4dc3f59884062985206d571bb4ce4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.554100 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf4dc3f59884062985206d571bb4ce4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.562081 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-19fb8c95-4ad8-4835-af77-c5f2b927667d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf4dc3f59884062985206d571bb4ce4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.581329 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1376/2747] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:29:30 2022] DELETE /identity/v3/users/ddf4dc3f59884062985206d571bb4ce4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:30.775801 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:30.777813 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:30.793852 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd61f8-8adf-4044-ab11-de0597e2fe38 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:30.857641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:30.858383 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:30.858732 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:30.859074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] PATH_INFO: `/v3/projects/a3a42690d78c4c47af697987aed304b6` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:30.860268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a42690d78c4c47af697987aed304b6)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:30.862400 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:30.897647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:30.913441 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a42690d78c4c47af697987aed304b6', 'request_id': 'req-eda8b117-699b-4c83-9ede-762f9db093ca'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.920435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a42690d78c4c47af697987aed304b6', 'request_id': 'req-eda8b117-699b-4c83-9ede-762f9db093ca'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.930166 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a42690d78c4c47af697987aed304b6', 'request_id': 'req-eda8b117-699b-4c83-9ede-762f9db093ca'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.945830 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] The token cache is being invalidate because project a3a42690d78c4c47af697987aed304b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:29:30.946625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.947270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-eda8b117-699b-4c83-9ede-762f9db093ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:30.949271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1372/2748] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:29:30 2022] DELETE /identity/v3/projects/a3a42690d78c4c47af697987aed304b6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:30.953951 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cccb0a-c658-4b56-8844-095581c796c2 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:30.954451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cccb0a-c658-4b56-8844-095581c796c2 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:30.954558 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cccb0a-c658-4b56-8844-095581c796c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:30.982167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-f0cccb0a-c658-4b56-8844-095581c796c2 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:30.983360 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-f0cccb0a-c658-4b56-8844-095581c796c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:31.043473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1377/2749] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:31.052551 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45900ac-b386-4c12-8f3f-15fa770c481a None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.052894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45900ac-b386-4c12-8f3f-15fa770c481a None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.053183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45900ac-b386-4c12-8f3f-15fa770c481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.075123 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-b45900ac-b386-4c12-8f3f-15fa770c481a None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:31.076426 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-b45900ac-b386-4c12-8f3f-15fa770c481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:31.084336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1373/2750] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:29:31.089524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cccb0a-c658-4b56-8844-095581c796c2 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:31.099423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cccb0a-c658-4b56-8844-095581c796c2 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:31.104065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbc686-626b-4d95-ab41-9792ffc04d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:31.104697 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbc686-626b-4d95-ab41-9792ffc04d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.104975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbc686-626b-4d95-ab41-9792ffc04d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.105242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbc686-626b-4d95-ab41-9792ffc04d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.106093 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbc686-626b-4d95-ab41-9792ffc04d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:29:31.106242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbc686-626b-4d95-ab41-9792ffc04d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:31.107823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbc686-626b-4d95-ab41-9792ffc04d0f admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:31.119914 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1378/2751] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:29:31.124344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45900ac-b386-4c12-8f3f-15fa770c481a None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:31.135331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45900ac-b386-4c12-8f3f-15fa770c481a None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:31.140010 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b4fce-80b2-48e0-b1cb-a99be72881e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:31.140652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4fce-80b2-48e0-b1cb-a99be72881e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.140934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4fce-80b2-48e0-b1cb-a99be72881e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.141198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4fce-80b2-48e0-b1cb-a99be72881e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.141822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b4fce-80b2-48e0-b1cb-a99be72881e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:31.143737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b4fce-80b2-48e0-b1cb-a99be72881e7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:31.172569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1374/2752] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:29:31 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:29:31.176752 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbc686-626b-4d95-ab41-9792ffc04d0f admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:31.187837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbc686-626b-4d95-ab41-9792ffc04d0f admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:31.247765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd101f-cc2d-47d6-ad8d-70dcaea2ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:31.248376 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd101f-cc2d-47d6-ad8d-70dcaea2ac26 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.248671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd101f-cc2d-47d6-ad8d-70dcaea2ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.248941 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd101f-cc2d-47d6-ad8d-70dcaea2ac26 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.249552 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd101f-cc2d-47d6-ad8d-70dcaea2ac26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:31.251496 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd101f-cc2d-47d6-ad8d-70dcaea2ac26 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:31.275765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1379/2753] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:29:31 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:29:31.280694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b4fce-80b2-48e0-b1cb-a99be72881e7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:31.292224 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b4fce-80b2-48e0-b1cb-a99be72881e7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:31.299013 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf13614-fbe9-4c33-8fc2-4ffc2c3b7fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:31.299776 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf13614-fbe9-4c33-8fc2-4ffc2c3b7fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.300358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf13614-fbe9-4c33-8fc2-4ffc2c3b7fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.300649 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf13614-fbe9-4c33-8fc2-4ffc2c3b7fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.301901 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf13614-fbe9-4c33-8fc2-4ffc2c3b7fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:31.304270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf13614-fbe9-4c33-8fc2-4ffc2c3b7fcf admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:31.315061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1375/2754] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:29:31.319050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd101f-cc2d-47d6-ad8d-70dcaea2ac26 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:31.329572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd101f-cc2d-47d6-ad8d-70dcaea2ac26 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:31.334304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94feb7-c297-4cb9-9677-281fe5928b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:31.334895 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94feb7-c297-4cb9-9677-281fe5928b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.335166 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94feb7-c297-4cb9-9677-281fe5928b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.335428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94feb7-c297-4cb9-9677-281fe5928b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.336084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94feb7-c297-4cb9-9677-281fe5928b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:31.338433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94feb7-c297-4cb9-9677-281fe5928b33 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:31.351144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1380/2755] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:29:31.355731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf13614-fbe9-4c33-8fc2-4ffc2c3b7fcf admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:31.365628 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf13614-fbe9-4c33-8fc2-4ffc2c3b7fcf admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:31.370452 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901caa3e-7241-48b8-b4c4-d808d6c09526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:31.371102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901caa3e-7241-48b8-b4c4-d808d6c09526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.371375 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901caa3e-7241-48b8-b4c4-d808d6c09526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.371643 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901caa3e-7241-48b8-b4c4-d808d6c09526 admin admin] PATH_INFO: `/v3/projects/4a76f5959a2e455bac378ca80aef165f/users/e7cfc351455744afaeb6354e04013cb2/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.386021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901caa3e-7241-48b8-b4c4-d808d6c09526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a76f5959a2e455bac378ca80aef165f, user_id=e7cfc351455744afaeb6354e04013cb2, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:31.388665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901caa3e-7241-48b8-b4c4-d808d6c09526 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:31.404207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1376/2756] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:29:31 2022] PUT /identity/v3/projects/4a76f5959a2e455bac378ca80aef165f/users/e7cfc351455744afaeb6354e04013cb2/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:31.409368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00cc5e-afe0-4df3-896f-9ed4674b8314 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.409788 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00cc5e-afe0-4df3-896f-9ed4674b8314 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.410051 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00cc5e-afe0-4df3-896f-9ed4674b8314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.419204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:31.434163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-1c00cc5e-afe0-4df3-896f-9ed4674b8314 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:31.435377 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-1c00cc5e-afe0-4df3-896f-9ed4674b8314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:31.498541 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1381/2757] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:29:31.506453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901caa3e-7241-48b8-b4c4-d808d6c09526 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:31.508272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-901caa3e-7241-48b8-b4c4-d808d6c09526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:31.528216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a01652-7122-4b10-a0a4-c7a7f749b391 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.528517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a01652-7122-4b10-a0a4-c7a7f749b391 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.529181 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a01652-7122-4b10-a0a4-c7a7f749b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.547782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-47a01652-7122-4b10-a0a4-c7a7f749b391 None None] MFA Rules not processed for user `829300ee1bbe4dddb264eca8cf7c2df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:31.548927 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-47a01652-7122-4b10-a0a4-c7a7f749b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:31.569664 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901caa3e-7241-48b8-b4c4-d808d6c09526 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:31.574569 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c3357-dcde-47ff-bc98-718c68b635fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:31.575201 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c3357-dcde-47ff-bc98-718c68b635fc service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.575477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c3357-dcde-47ff-bc98-718c68b635fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.575745 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c3357-dcde-47ff-bc98-718c68b635fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.584983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c3357-dcde-47ff-bc98-718c68b635fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:31.586417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c3357-dcde-47ff-bc98-718c68b635fc service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:31.596577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1377/2758] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:31.610184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1382/2759] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:29:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:29:32.438172 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa1f2-6311-42ee-8a0f-c9ed529636d8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:32.439302 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa1f2-6311-42ee-8a0f-c9ed529636d8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:32.439897 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa1f2-6311-42ee-8a0f-c9ed529636d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:32.485692 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-796aa1f2-6311-42ee-8a0f-c9ed529636d8 None None] MFA Rules not processed for user `e7cfc351455744afaeb6354e04013cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:32.488750 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-796aa1f2-6311-42ee-8a0f-c9ed529636d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:32.544761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:32.573959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1378/2760] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:29:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:32.585184 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a01652-7122-4b10-a0a4-c7a7f749b391 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:32.587537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-47a01652-7122-4b10-a0a4-c7a7f749b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:32.653564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a01652-7122-4b10-a0a4-c7a7f749b391 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:32.657273 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1bf57-f5c7-4d39-a268-1fd746348db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:32.658049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1bf57-f5c7-4d39-a268-1fd746348db5 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:32.658356 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1bf57-f5c7-4d39-a268-1fd746348db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:32.658625 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1bf57-f5c7-4d39-a268-1fd746348db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:32.667966 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1bf57-f5c7-4d39-a268-1fd746348db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:32.669430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1bf57-f5c7-4d39-a268-1fd746348db5 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:32.678807 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1383/2761] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:34.067374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585ec4-1f70-41bb-8b0b-4e37f35371e1 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:34.067834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585ec4-1f70-41bb-8b0b-4e37f35371e1 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:34.068111 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585ec4-1f70-41bb-8b0b-4e37f35371e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:34.091474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-76585ec4-1f70-41bb-8b0b-4e37f35371e1 None None] MFA Rules not processed for user `e7cfc351455744afaeb6354e04013cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:34.092729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-76585ec4-1f70-41bb-8b0b-4e37f35371e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:34.100295 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1379/2762] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:29:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:42.674601 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=76 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:44.084590 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=8 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:44.422806 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1bf57-f5c7-4d39-a268-1fd746348db5 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:44.423847 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-6bc1bf57-f5c7-4d39-a268-1fd746348db5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:44.580109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1bf57-f5c7-4d39-a268-1fd746348db5 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:44.585524 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4f853-9d46-445e-9ab2-d416d3efb231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98925192a33544e081f1a02faed60b7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:44.586126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4f853-9d46-445e-9ab2-d416d3efb231 service nova] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:44.586400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4f853-9d46-445e-9ab2-d416d3efb231 service nova] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:44.586670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4f853-9d46-445e-9ab2-d416d3efb231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:44.588387 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-01a4f853-9d46-445e-9ab2-d416d3efb231 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:44.601334 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4f853-9d46-445e-9ab2-d416d3efb231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:44.602942 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4f853-9d46-445e-9ab2-d416d3efb231 service nova] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:44.614113 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1384/2763] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:45.331921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76585ec4-1f70-41bb-8b0b-4e37f35371e1 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:45.334026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-76585ec4-1f70-41bb-8b0b-4e37f35371e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:45.492733 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76585ec4-1f70-41bb-8b0b-4e37f35371e1 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:45.498705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d38ab5-cc60-4da6-8d3b-baf041e05636 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:45.499308 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38ab5-cc60-4da6-8d3b-baf041e05636 service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:45.499583 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38ab5-cc60-4da6-8d3b-baf041e05636 service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:45.499847 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38ab5-cc60-4da6-8d3b-baf041e05636 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:45.501780 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e5d38ab5-cc60-4da6-8d3b-baf041e05636 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:45.514259 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d38ab5-cc60-4da6-8d3b-baf041e05636 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:45.515855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d38ab5-cc60-4da6-8d3b-baf041e05636 service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:45.527357 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1380/2764] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:49.327644 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7978-5e59-4799-bffb-d4c41453ce4f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:49.328339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7978-5e59-4799-bffb-d4c41453ce4f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:49.328339 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7978-5e59-4799-bffb-d4c41453ce4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:49.347308 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-d09e7978-5e59-4799-bffb-d4c41453ce4f None None] MFA Rules not processed for user `e7cfc351455744afaeb6354e04013cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:49.348505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d09e7978-5e59-4799-bffb-d4c41453ce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:49.356157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1385/2765] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:29:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:55.521789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=53 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:59.342058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=71 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:05.024356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54035da6-da40-41fb-8af1-dfa70505a746 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:05.024936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54035da6-da40-41fb-8af1-dfa70505a746 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:05.024936 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54035da6-da40-41fb-8af1-dfa70505a746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:05.055067 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-54035da6-da40-41fb-8af1-dfa70505a746 None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:05.056279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-54035da6-da40-41fb-8af1-dfa70505a746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:05.116307 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1381/2766] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Aug 9 12:30:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:05.172684 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e7978-5e59-4799-bffb-d4c41453ce4f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:05.174319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-d09e7978-5e59-4799-bffb-d4c41453ce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:05.274189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e7978-5e59-4799-bffb-d4c41453ce4f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:05.280035 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6693e-ab6e-46de-b511-4e61e32fcbc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:05.280670 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6693e-ab6e-46de-b511-4e61e32fcbc8 service swift] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:05.280949 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6693e-ab6e-46de-b511-4e61e32fcbc8 service swift] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:05.281217 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6693e-ab6e-46de-b511-4e61e32fcbc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:05.292876 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6693e-ab6e-46de-b511-4e61e32fcbc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:05.295412 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6693e-ab6e-46de-b511-4e61e32fcbc8 service swift] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:05.307177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1386/2767] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:30:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:30:10.530090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54035da6-da40-41fb-8af1-dfa70505a746 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:10.531737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-54035da6-da40-41fb-8af1-dfa70505a746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:10.589045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54035da6-da40-41fb-8af1-dfa70505a746 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:10.594442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:10.595571 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:10.596094 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:10.596442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] PATH_INFO: `/v3/users/27cd2e122c0e4853a2c5b48734aa9b11` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:10.597784 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cd2e122c0e4853a2c5b48734aa9b11)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:10.599786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:10.659949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cd2e122c0e4853a2c5b48734aa9b11'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:10.672358 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cd2e122c0e4853a2c5b48734aa9b11'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:10.673234 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cd2e122c0e4853a2c5b48734aa9b11'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:10.674033 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cd2e122c0e4853a2c5b48734aa9b11'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:10.685161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cd2e122c0e4853a2c5b48734aa9b11'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:10.707926 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1382/2768] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:10 2022] DELETE /identity/v3/users/27cd2e122c0e4853a2c5b48734aa9b11 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:10.934453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6693e-ab6e-46de-b511-4e61e32fcbc8 service swift] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:10.951244 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6693e-ab6e-46de-b511-4e61e32fcbc8 service swift] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:11.038929 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:11.039482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:11.039955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:11.040400 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] PATH_INFO: `/v3/projects/d7a8bf1f0c0f4f61b70cca7ae41ba072` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:11.041740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a8bf1f0c0f4f61b70cca7ae41ba072)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:11.043996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:11.097047 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a8bf1f0c0f4f61b70cca7ae41ba072', 'request_id': 'req-220829ba-b5ab-47b2-b3b1-fca649d6daa7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.103286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a8bf1f0c0f4f61b70cca7ae41ba072', 'request_id': 'req-220829ba-b5ab-47b2-b3b1-fca649d6daa7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.111429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a8bf1f0c0f4f61b70cca7ae41ba072', 'request_id': 'req-220829ba-b5ab-47b2-b3b1-fca649d6daa7'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.123687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] The token cache is being invalidate because project d7a8bf1f0c0f4f61b70cca7ae41ba072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:11.124058 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.126232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.128070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1387/2769] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:10 2022] DELETE /identity/v3/projects/d7a8bf1f0c0f4f61b70cca7ae41ba072 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:11.132151 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:11.133985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:11.149350 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256cf07-8f0a-4fe8-927b-f54f5a5c3426 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:11.214744 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:11.236890 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:11.237629 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:11.237983 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:11.238323 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] PATH_INFO: `/v3/users/aee83691ac684778b6d8384f27a675d7` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:11.240273 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee83691ac684778b6d8384f27a675d7)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:11.241703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:11.302155 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee83691ac684778b6d8384f27a675d7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.310040 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee83691ac684778b6d8384f27a675d7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.310746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee83691ac684778b6d8384f27a675d7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.311379 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee83691ac684778b6d8384f27a675d7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.321398 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c9a6ff53-9ec2-49bf-bc85-60a736e255d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee83691ac684778b6d8384f27a675d7'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.347898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1383/2770] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:11 2022] DELETE /identity/v3/users/aee83691ac684778b6d8384f27a675d7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:11.669277 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:11.672957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:11.692534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220829ba-b5ab-47b2-b3b1-fca649d6daa7 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:11.712064 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:11.759318 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:11.759970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:11.761055 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:11.761435 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] PATH_INFO: `/v3/projects/55cf287a0a1a42da8022dd3dbd1204db` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:11.762590 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] RBAC: Authorizing `identity:delete_project(project_id=55cf287a0a1a42da8022dd3dbd1204db)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:11.764497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:11.819410 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55cf287a0a1a42da8022dd3dbd1204db', 'request_id': 'req-08a502a8-7569-470d-ae95-1074ff8b735d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.825593 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55cf287a0a1a42da8022dd3dbd1204db', 'request_id': 'req-08a502a8-7569-470d-ae95-1074ff8b735d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.835930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55cf287a0a1a42da8022dd3dbd1204db', 'request_id': 'req-08a502a8-7569-470d-ae95-1074ff8b735d'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.850206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] The token cache is being invalidate because project 55cf287a0a1a42da8022dd3dbd1204db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:11.852006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.852716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:11.856659 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1388/2771] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:11 2022] DELETE /identity/v3/projects/55cf287a0a1a42da8022dd3dbd1204db => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:21.343665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:21.846716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:21.960285 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb6f41-197d-404e-b595-9b827a729b7d None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.960572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb6f41-197d-404e-b595-9b827a729b7d None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.961498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb6f41-197d-404e-b595-9b827a729b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.982381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e3bb6f41-197d-404e-b595-9b827a729b7d None None] MFA Rules not processed for user `6c806e8c13414c38ad398069bfa2f03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:21.984118 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e3bb6f41-197d-404e-b595-9b827a729b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:22.046466 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1384/2772] 10.222.0.25 () {58 vars in 967 bytes} [Tue Aug 9 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:22.058506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:22.059891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:22.131180 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a502a8-7569-470d-ae95-1074ff8b735d admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:22.137263 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265b730-9665-4b97-b6b7-06d30fd282b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f9b96629544596a8d9b81cce57af21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:22.137871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265b730-9665-4b97-b6b7-06d30fd282b7 service swift] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:22.138150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265b730-9665-4b97-b6b7-06d30fd282b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:22.138424 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265b730-9665-4b97-b6b7-06d30fd282b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:22.146553 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265b730-9665-4b97-b6b7-06d30fd282b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:22.148175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265b730-9665-4b97-b6b7-06d30fd282b7 service swift] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:22.156936 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1389/2773] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Aug 9 12:30:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:30:24.103825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb6f41-197d-404e-b595-9b827a729b7d None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:24.105615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e3bb6f41-197d-404e-b595-9b827a729b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:24.172832 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb6f41-197d-404e-b595-9b827a729b7d None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:24.177182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:24.177802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.178074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.178340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] PATH_INFO: `/v3/users/e7cfc351455744afaeb6354e04013cb2` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.179447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7cfc351455744afaeb6354e04013cb2)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:24.181392 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:24.226271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7cfc351455744afaeb6354e04013cb2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.233490 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7cfc351455744afaeb6354e04013cb2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.234137 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7cfc351455744afaeb6354e04013cb2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.234731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7cfc351455744afaeb6354e04013cb2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.241797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7cfc351455744afaeb6354e04013cb2'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.259648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1385/2774] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:24 2022] DELETE /identity/v3/users/e7cfc351455744afaeb6354e04013cb2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:24.440171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265b730-9665-4b97-b6b7-06d30fd282b7 service swift] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:24.453543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265b730-9665-4b97-b6b7-06d30fd282b7 service swift] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:24.516997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:24.517674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.517962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.518228 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] PATH_INFO: `/v3/projects/4a76f5959a2e455bac378ca80aef165f` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.519359 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a76f5959a2e455bac378ca80aef165f)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:24.521358 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:24.571225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a76f5959a2e455bac378ca80aef165f', 'request_id': 'req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.577169 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a76f5959a2e455bac378ca80aef165f', 'request_id': 'req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.586071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a76f5959a2e455bac378ca80aef165f', 'request_id': 'req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.597962 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] The token cache is being invalidate because project 4a76f5959a2e455bac378ca80aef165f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:24.598252 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.598899 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.600375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1390/2775] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:24 2022] DELETE /identity/v3/projects/4a76f5959a2e455bac378ca80aef165f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:34.256070 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:34.594777 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:41.361995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:41.363487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:41.377185 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bedf25d-f2a6-4938-95de-1af9f6b53c1b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:41.437855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:41.438582 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:41.438861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:41.439129 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] PATH_INFO: `/v3/users/829300ee1bbe4dddb264eca8cf7c2df8` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:41.440270 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829300ee1bbe4dddb264eca8cf7c2df8)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:41.442341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:41.495393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829300ee1bbe4dddb264eca8cf7c2df8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:41.502524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829300ee1bbe4dddb264eca8cf7c2df8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:41.503187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829300ee1bbe4dddb264eca8cf7c2df8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:41.503775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829300ee1bbe4dddb264eca8cf7c2df8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:41.512670 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-527eb922-1cb8-45cb-a4fc-e190966e93a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829300ee1bbe4dddb264eca8cf7c2df8'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:41.530268 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1386/2776] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:41 2022] DELETE /identity/v3/users/829300ee1bbe4dddb264eca8cf7c2df8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:41.702005 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:41.703466 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:41.719757 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f0db5-955a-4f1f-8f9b-2b33ca8558d9 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:41.776162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:41.776749 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:41.777030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:41.777306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] PATH_INFO: `/v3/projects/091626d622d543df88c2042d76f16529` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:41.778406 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=091626d622d543df88c2042d76f16529)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:41.780300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:41.825755 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091626d622d543df88c2042d76f16529', 'request_id': 'req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:41.831281 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091626d622d543df88c2042d76f16529', 'request_id': 'req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:41.839118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091626d622d543df88c2042d76f16529', 'request_id': 'req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:41.849982 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] The token cache is being invalidate because project 091626d622d543df88c2042d76f16529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:41.850266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:41.850873 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-b458de9e-2f4b-4d98-90fb-d4cb7c71d1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:41.852351 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1391/2777] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:41 2022] DELETE /identity/v3/projects/091626d622d543df88c2042d76f16529 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:41.857857 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2db6f-4383-4054-91e2-d5a57fd2a208 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:41.858140 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2db6f-4383-4054-91e2-d5a57fd2a208 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:41.858415 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2db6f-4383-4054-91e2-d5a57fd2a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:41.914803 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e8d2db6f-4383-4054-91e2-d5a57fd2a208 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:41.916577 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e8d2db6f-4383-4054-91e2-d5a57fd2a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:41.958760 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:41.976730 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1387/2778] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:41.985163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5032e-c1d4-4603-8229-6a35e1695f1f None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:41.985448 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5032e-c1d4-4603-8229-6a35e1695f1f None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:41.985718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5032e-c1d4-4603-8229-6a35e1695f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:42.005405 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-74f5032e-c1d4-4603-8229-6a35e1695f1f None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:42.006597 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-74f5032e-c1d4-4603-8229-6a35e1695f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:42.015926 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1392/2779] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:42.020134 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2db6f-4383-4054-91e2-d5a57fd2a208 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:42.030260 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2db6f-4383-4054-91e2-d5a57fd2a208 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:42.034844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208b70-3aa6-4520-93ae-a715620ebed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:42.035447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208b70-3aa6-4520-93ae-a715620ebed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:42.035740 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208b70-3aa6-4520-93ae-a715620ebed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:42.035998 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208b70-3aa6-4520-93ae-a715620ebed7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:42.036665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31208b70-3aa6-4520-93ae-a715620ebed7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:30:42.036971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31208b70-3aa6-4520-93ae-a715620ebed7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:42.038564 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31208b70-3aa6-4520-93ae-a715620ebed7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:42.051611 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1388/2780] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:30:42.056782 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5032e-c1d4-4603-8229-6a35e1695f1f None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:42.066605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5032e-c1d4-4603-8229-6a35e1695f1f None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:42.071586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d63406-5da4-45f9-99f2-1d5a447bd404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:42.072269 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d63406-5da4-45f9-99f2-1d5a447bd404 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:42.072548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d63406-5da4-45f9-99f2-1d5a447bd404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:42.072853 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d63406-5da4-45f9-99f2-1d5a447bd404 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:42.073482 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d63406-5da4-45f9-99f2-1d5a447bd404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:42.075388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d63406-5da4-45f9-99f2-1d5a447bd404 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:42.105626 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1393/2781] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:42 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:30:42.109893 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208b70-3aa6-4520-93ae-a715620ebed7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:42.121023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208b70-3aa6-4520-93ae-a715620ebed7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:42.177327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5923ab2-0d51-4dc7-9911-18e0811a3960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:42.177930 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923ab2-0d51-4dc7-9911-18e0811a3960 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:42.178218 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923ab2-0d51-4dc7-9911-18e0811a3960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:42.178487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923ab2-0d51-4dc7-9911-18e0811a3960 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:42.179117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5923ab2-0d51-4dc7-9911-18e0811a3960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:42.181753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5923ab2-0d51-4dc7-9911-18e0811a3960 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:42.205036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1389/2782] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:42 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:42.209738 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d63406-5da4-45f9-99f2-1d5a447bd404 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:42.221280 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d63406-5da4-45f9-99f2-1d5a447bd404 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:42.226336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844607c-a9ce-4c84-bdfd-51367e07bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:42.226933 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844607c-a9ce-4c84-bdfd-51367e07bd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:42.227243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844607c-a9ce-4c84-bdfd-51367e07bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:42.227563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844607c-a9ce-4c84-bdfd-51367e07bd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:42.228191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844607c-a9ce-4c84-bdfd-51367e07bd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:42.229824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844607c-a9ce-4c84-bdfd-51367e07bd5a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:42.240615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1394/2783] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:30:42.244727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5923ab2-0d51-4dc7-9911-18e0811a3960 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:42.254962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5923ab2-0d51-4dc7-9911-18e0811a3960 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:42.260253 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1710-b9db-4b44-9164-82fcf1df7531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:42.260884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1710-b9db-4b44-9164-82fcf1df7531 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:42.261161 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1710-b9db-4b44-9164-82fcf1df7531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:42.261436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1710-b9db-4b44-9164-82fcf1df7531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:42.262074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b1710-b9db-4b44-9164-82fcf1df7531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:42.263669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b1710-b9db-4b44-9164-82fcf1df7531 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:42.275662 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1390/2784] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:42.279826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844607c-a9ce-4c84-bdfd-51367e07bd5a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:42.291731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844607c-a9ce-4c84-bdfd-51367e07bd5a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:42.297023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe3af-4eeb-4861-b6b2-84bc8b5aa56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:42.297673 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe3af-4eeb-4861-b6b2-84bc8b5aa56e admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:42.297976 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe3af-4eeb-4861-b6b2-84bc8b5aa56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:42.298243 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe3af-4eeb-4861-b6b2-84bc8b5aa56e admin admin] PATH_INFO: `/v3/projects/69ad86dcf30a424885589f6e69221c2c/users/f94eef0292d441168dda0690338ccc08/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:42.316816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe3af-4eeb-4861-b6b2-84bc8b5aa56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ad86dcf30a424885589f6e69221c2c, user_id=f94eef0292d441168dda0690338ccc08, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:42.319492 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe3af-4eeb-4861-b6b2-84bc8b5aa56e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:42.334034 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1395/2785] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:42 2022] PUT /identity/v3/projects/69ad86dcf30a424885589f6e69221c2c/users/f94eef0292d441168dda0690338ccc08/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:42.339738 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433b95-5b0b-472a-beab-d154821ec270 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:42.340021 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433b95-5b0b-472a-beab-d154821ec270 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:42.340291 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433b95-5b0b-472a-beab-d154821ec270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:42.358811 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-77433b95-5b0b-472a-beab-d154821ec270 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:42.359985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-77433b95-5b0b-472a-beab-d154821ec270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:42.419103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1391/2786] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:42.429056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe3af-4eeb-4861-b6b2-84bc8b5aa56e admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:42.431516 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-598fe3af-4eeb-4861-b6b2-84bc8b5aa56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:42.461572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:42.512374 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe3af-4eeb-4861-b6b2-84bc8b5aa56e admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:42.516098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c05f4-1266-429f-bdd1-cc00c977a648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:42.516728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c05f4-1266-429f-bdd1-cc00c977a648 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:42.517009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c05f4-1266-429f-bdd1-cc00c977a648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:42.517278 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c05f4-1266-429f-bdd1-cc00c977a648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:42.526155 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c05f4-1266-429f-bdd1-cc00c977a648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:42.527574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c05f4-1266-429f-bdd1-cc00c977a648 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:42.536954 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1396/2787] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:43.142773 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c53ec-ccd5-4384-bad3-a95ef9246b41 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:43.143060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c53ec-ccd5-4384-bad3-a95ef9246b41 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:43.143328 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c53ec-ccd5-4384-bad3-a95ef9246b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:43.172565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-572c53ec-ccd5-4384-bad3-a95ef9246b41 None None] MFA Rules not processed for user `f94eef0292d441168dda0690338ccc08`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:43.173795 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-572c53ec-ccd5-4384-bad3-a95ef9246b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:43.218773 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:43.242271 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1392/2788] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:43 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:43.246767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c05f4-1266-429f-bdd1-cc00c977a648 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:43.256667 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c05f4-1266-429f-bdd1-cc00c977a648 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:43.261769 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae2cdb-85c8-4123-b17f-7ad9fd935501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:43.262429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae2cdb-85c8-4123-b17f-7ad9fd935501 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:43.263375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae2cdb-85c8-4123-b17f-7ad9fd935501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:43.263375 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae2cdb-85c8-4123-b17f-7ad9fd935501 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:43.263781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae2cdb-85c8-4123-b17f-7ad9fd935501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:43.265787 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae2cdb-85c8-4123-b17f-7ad9fd935501 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:43.295837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1397/2789] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:43 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:43.299922 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c53ec-ccd5-4384-bad3-a95ef9246b41 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:43.311064 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c53ec-ccd5-4384-bad3-a95ef9246b41 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:43.374880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8d6e9-a791-49f1-9265-f4382dffcb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:43.375487 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8d6e9-a791-49f1-9265-f4382dffcb23 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:43.375764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8d6e9-a791-49f1-9265-f4382dffcb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:43.376034 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8d6e9-a791-49f1-9265-f4382dffcb23 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:43.376668 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8d6e9-a791-49f1-9265-f4382dffcb23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:43.378580 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8d6e9-a791-49f1-9265-f4382dffcb23 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:43.400296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1393/2790] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:43 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:43.404109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae2cdb-85c8-4123-b17f-7ad9fd935501 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:43.414347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae2cdb-85c8-4123-b17f-7ad9fd935501 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:43.419538 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d13f43-821d-451b-a2a8-b425e6065b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:43.420130 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d13f43-821d-451b-a2a8-b425e6065b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:43.420678 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d13f43-821d-451b-a2a8-b425e6065b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:43.420947 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d13f43-821d-451b-a2a8-b425e6065b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:43.421581 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d13f43-821d-451b-a2a8-b425e6065b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:43.423156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d13f43-821d-451b-a2a8-b425e6065b41 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:43.433262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1398/2791] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:43.437363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8d6e9-a791-49f1-9265-f4382dffcb23 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:43.447520 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8d6e9-a791-49f1-9265-f4382dffcb23 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:43.452112 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad81a03-771c-4d01-984a-7869c77f7e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:43.452793 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad81a03-771c-4d01-984a-7869c77f7e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:43.453071 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad81a03-771c-4d01-984a-7869c77f7e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:43.453343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad81a03-771c-4d01-984a-7869c77f7e7b admin admin] PATH_INFO: `/v3/projects/3f4465874ba4496e8468d6dce7dfe367/users/8b93b2f03cec41fe8a43de4d31df4131/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:43.469102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad81a03-771c-4d01-984a-7869c77f7e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4465874ba4496e8468d6dce7dfe367, user_id=8b93b2f03cec41fe8a43de4d31df4131, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:43.471726 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad81a03-771c-4d01-984a-7869c77f7e7b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:43.485108 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1394/2792] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:43 2022] PUT /identity/v3/projects/3f4465874ba4496e8468d6dce7dfe367/users/8b93b2f03cec41fe8a43de4d31df4131/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:30:43.489050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d13f43-821d-451b-a2a8-b425e6065b41 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:43.499775 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d13f43-821d-451b-a2a8-b425e6065b41 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:43.556266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63416db-421b-430f-aeb4-eca85ecf51ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:43.556896 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63416db-421b-430f-aeb4-eca85ecf51ed admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:43.557178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63416db-421b-430f-aeb4-eca85ecf51ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:43.557450 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63416db-421b-430f-aeb4-eca85ecf51ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:43.558079 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63416db-421b-430f-aeb4-eca85ecf51ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:43.559674 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63416db-421b-430f-aeb4-eca85ecf51ed admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:43.569175 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1399/2793] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:43.573313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad81a03-771c-4d01-984a-7869c77f7e7b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:43.583622 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad81a03-771c-4d01-984a-7869c77f7e7b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:43.588226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079855-dc9f-49b6-bf95-02fc85e15a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:43.588898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079855-dc9f-49b6-bf95-02fc85e15a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:43.589180 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079855-dc9f-49b6-bf95-02fc85e15a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:43.589449 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079855-dc9f-49b6-bf95-02fc85e15a7c admin admin] PATH_INFO: `/v3/projects/3f4465874ba4496e8468d6dce7dfe367/users/8b93b2f03cec41fe8a43de4d31df4131/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:43.591344 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c079855-dc9f-49b6-bf95-02fc85e15a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4465874ba4496e8468d6dce7dfe367, user_id=8b93b2f03cec41fe8a43de4d31df4131, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:43.594059 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c079855-dc9f-49b6-bf95-02fc85e15a7c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:43.604633 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1395/2794] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:43 2022] PUT /identity/v3/projects/3f4465874ba4496e8468d6dce7dfe367/users/8b93b2f03cec41fe8a43de4d31df4131/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:44.235219 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78d68-2dea-45df-aa68-c68d9fadd2d1 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:44.235505 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78d68-2dea-45df-aa68-c68d9fadd2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:44.235774 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78d68-2dea-45df-aa68-c68d9fadd2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:44.265856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-bea78d68-2dea-45df-aa68-c68d9fadd2d1 None None] MFA Rules not processed for user `8b93b2f03cec41fe8a43de4d31df4131`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:44.267218 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-bea78d68-2dea-45df-aa68-c68d9fadd2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:44.341627 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:44.349033 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1400/2795] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:44.800133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079855-dc9f-49b6-bf95-02fc85e15a7c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:44.801898 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5c079855-dc9f-49b6-bf95-02fc85e15a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:44.879530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079855-dc9f-49b6-bf95-02fc85e15a7c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:44.884829 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd35747-6b86-44aa-a5c2-c42579be6209 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:44.885444 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd35747-6b86-44aa-a5c2-c42579be6209 service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:44.885727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd35747-6b86-44aa-a5c2-c42579be6209 service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:44.885995 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd35747-6b86-44aa-a5c2-c42579be6209 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:44.887766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1fd35747-6b86-44aa-a5c2-c42579be6209 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:44.900969 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd35747-6b86-44aa-a5c2-c42579be6209 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:44.902484 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd35747-6b86-44aa-a5c2-c42579be6209 service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:44.912886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1396/2796] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:45.624912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea78d68-2dea-45df-aa68-c68d9fadd2d1 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:45.689801 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea78d68-2dea-45df-aa68-c68d9fadd2d1 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:45.694251 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:45.694867 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:45.695142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:45.695409 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] PATH_INFO: `/v3/users/f94eef0292d441168dda0690338ccc08` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:45.697084 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94eef0292d441168dda0690338ccc08)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:45.698993 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:45.743444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94eef0292d441168dda0690338ccc08'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:45.750384 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94eef0292d441168dda0690338ccc08'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:45.750985 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94eef0292d441168dda0690338ccc08'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:45.751577 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94eef0292d441168dda0690338ccc08'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:45.758461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94eef0292d441168dda0690338ccc08'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:45.776080 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1401/2797] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:45 2022] DELETE /identity/v3/users/f94eef0292d441168dda0690338ccc08 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:45.947976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd35747-6b86-44aa-a5c2-c42579be6209 service placement] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:45.959427 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd35747-6b86-44aa-a5c2-c42579be6209 service placement] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:45.984757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:46.017353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:46.017986 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.018241 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.018504 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] PATH_INFO: `/v3/projects/69ad86dcf30a424885589f6e69221c2c` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.019616 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ad86dcf30a424885589f6e69221c2c)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:46.021521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:46.066713 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ad86dcf30a424885589f6e69221c2c', 'request_id': 'req-47f0a288-d594-4c85-86f0-b3edfadd90f5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.072371 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ad86dcf30a424885589f6e69221c2c', 'request_id': 'req-47f0a288-d594-4c85-86f0-b3edfadd90f5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.079527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ad86dcf30a424885589f6e69221c2c', 'request_id': 'req-47f0a288-d594-4c85-86f0-b3edfadd90f5'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.090442 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] The token cache is being invalidate because project 69ad86dcf30a424885589f6e69221c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:46.090752 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.091372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.092962 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1397/2798] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:45 2022] DELETE /identity/v3/projects/69ad86dcf30a424885589f6e69221c2c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:46.097148 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:46.098542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:46.112843 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7965c-6a41-44f2-afcf-4c170eaf4802 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:46.170395 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:46.171021 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.171296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.171564 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] PATH_INFO: `/v3/users/8b93b2f03cec41fe8a43de4d31df4131` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.172718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b93b2f03cec41fe8a43de4d31df4131)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:46.174612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:46.194540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:46.220473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b93b2f03cec41fe8a43de4d31df4131'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.228765 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b93b2f03cec41fe8a43de4d31df4131'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.229368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b93b2f03cec41fe8a43de4d31df4131'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.229973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b93b2f03cec41fe8a43de4d31df4131'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.236842 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-425ef6f2-600f-470e-aa19-d093b0e37f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b93b2f03cec41fe8a43de4d31df4131'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.253749 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1402/2799] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:46 2022] DELETE /identity/v3/users/8b93b2f03cec41fe8a43de4d31df4131 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:46.424547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:46.426163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:46.439312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0a288-d594-4c85-86f0-b3edfadd90f5 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:46.497408 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:46.498065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.498315 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.498581 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] PATH_INFO: `/v3/projects/3f4465874ba4496e8468d6dce7dfe367` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.499695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4465874ba4496e8468d6dce7dfe367)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:46.501657 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:46.546701 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4465874ba4496e8468d6dce7dfe367', 'request_id': 'req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.551968 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4465874ba4496e8468d6dce7dfe367', 'request_id': 'req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.553592 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:46.559868 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4465874ba4496e8468d6dce7dfe367', 'request_id': 'req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.575489 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] The token cache is being invalidate because project 3f4465874ba4496e8468d6dce7dfe367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:46.575775 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.576446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7b07cd69-40d1-4b8b-bfa1-441b1976d4b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:46.577949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1398/2800] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:46 2022] DELETE /identity/v3/projects/3f4465874ba4496e8468d6dce7dfe367 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:46.582837 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d830154-59ff-4f50-8ac8-dd1565742049 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.583144 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d830154-59ff-4f50-8ac8-dd1565742049 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.583417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d830154-59ff-4f50-8ac8-dd1565742049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.603417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-4d830154-59ff-4f50-8ac8-dd1565742049 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:46.604614 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4d830154-59ff-4f50-8ac8-dd1565742049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:46.664337 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1403/2801] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:46.672422 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e850f79-eb5e-477e-b1e1-a292e2add2d9 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.672727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e850f79-eb5e-477e-b1e1-a292e2add2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.672996 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e850f79-eb5e-477e-b1e1-a292e2add2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.692045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-0e850f79-eb5e-477e-b1e1-a292e2add2d9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:46.693279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-0e850f79-eb5e-477e-b1e1-a292e2add2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:46.702092 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1399/2802] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:46.706123 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d830154-59ff-4f50-8ac8-dd1565742049 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:46.716688 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d830154-59ff-4f50-8ac8-dd1565742049 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:46.721237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d73e27-3ce2-4180-ae11-996ef2388992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:46.721824 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d73e27-3ce2-4180-ae11-996ef2388992 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.722101 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d73e27-3ce2-4180-ae11-996ef2388992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.722368 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d73e27-3ce2-4180-ae11-996ef2388992 admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.722997 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d73e27-3ce2-4180-ae11-996ef2388992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:30:46.723297 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d73e27-3ce2-4180-ae11-996ef2388992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:46.724908 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d73e27-3ce2-4180-ae11-996ef2388992 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:46.736241 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1404/2803] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:30:46.740360 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e850f79-eb5e-477e-b1e1-a292e2add2d9 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:46.749757 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e850f79-eb5e-477e-b1e1-a292e2add2d9 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:46.754331 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326f3e5-c474-4d57-9812-f703c8c84254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:46.754910 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f3e5-c474-4d57-9812-f703c8c84254 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.755181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f3e5-c474-4d57-9812-f703c8c84254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.755455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f3e5-c474-4d57-9812-f703c8c84254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.756060 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326f3e5-c474-4d57-9812-f703c8c84254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:46.757971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326f3e5-c474-4d57-9812-f703c8c84254 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:46.785309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1400/2804] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:46 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:30:46.789306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d73e27-3ce2-4180-ae11-996ef2388992 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:46.799711 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d73e27-3ce2-4180-ae11-996ef2388992 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:46.854833 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6fd8-7613-496b-b894-fda2198a6aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:46.855429 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6fd8-7613-496b-b894-fda2198a6aac admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.855705 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6fd8-7613-496b-b894-fda2198a6aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.855974 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa6fd8-7613-496b-b894-fda2198a6aac admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.856586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa6fd8-7613-496b-b894-fda2198a6aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:46.858621 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa6fd8-7613-496b-b894-fda2198a6aac admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:46.879398 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1405/2805] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:46 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:46.883656 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326f3e5-c474-4d57-9812-f703c8c84254 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:46.894833 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326f3e5-c474-4d57-9812-f703c8c84254 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:46.899565 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9659-f1ff-4ba6-80bf-d7fd8d0113f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:46.900183 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9659-f1ff-4ba6-80bf-d7fd8d0113f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.900458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9659-f1ff-4ba6-80bf-d7fd8d0113f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.900763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9659-f1ff-4ba6-80bf-d7fd8d0113f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.901402 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f9659-f1ff-4ba6-80bf-d7fd8d0113f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:46.902978 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f9659-f1ff-4ba6-80bf-d7fd8d0113f3 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:46.912902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1401/2806] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:46.916831 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6fd8-7613-496b-b894-fda2198a6aac admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:46.927041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa6fd8-7613-496b-b894-fda2198a6aac admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:46.932178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ee87d-d351-442f-a7de-63932ed03483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:46.932970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ee87d-d351-442f-a7de-63932ed03483 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.933246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ee87d-d351-442f-a7de-63932ed03483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.933515 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ee87d-d351-442f-a7de-63932ed03483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.934142 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ee87d-d351-442f-a7de-63932ed03483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:46.935723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ee87d-d351-442f-a7de-63932ed03483 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:46.946049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1406/2807] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:46.950653 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9659-f1ff-4ba6-80bf-d7fd8d0113f3 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:46.960746 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9659-f1ff-4ba6-80bf-d7fd8d0113f3 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:46.966020 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dda3ef-32bf-44c2-8d78-c696e9395e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:46.966782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda3ef-32bf-44c2-8d78-c696e9395e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:46.967090 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda3ef-32bf-44c2-8d78-c696e9395e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:46.967352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda3ef-32bf-44c2-8d78-c696e9395e22 admin admin] PATH_INFO: `/v3/projects/3bad43a42ca1409eb51f50298e9b5e25/users/8382ee9554b34db7904416355d2e60b4/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:46.982617 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dda3ef-32bf-44c2-8d78-c696e9395e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bad43a42ca1409eb51f50298e9b5e25, user_id=8382ee9554b34db7904416355d2e60b4, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:46.985345 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dda3ef-32bf-44c2-8d78-c696e9395e22 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:46.998352 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1402/2808] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:46 2022] PUT /identity/v3/projects/3bad43a42ca1409eb51f50298e9b5e25/users/8382ee9554b34db7904416355d2e60b4/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:30:47.009451 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374237b4-4606-49e6-a9ce-dc6e1d76037b None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:47.010320 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374237b4-4606-49e6-a9ce-dc6e1d76037b None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:47.010561 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374237b4-4606-49e6-a9ce-dc6e1d76037b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:47.018178 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:47.042304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-374237b4-4606-49e6-a9ce-dc6e1d76037b None None] MFA Rules not processed for user `8382ee9554b34db7904416355d2e60b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:47.043506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-374237b4-4606-49e6-a9ce-dc6e1d76037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:47.107104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1407/2809] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:47.111632 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dda3ef-32bf-44c2-8d78-c696e9395e22 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:47.172851 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dda3ef-32bf-44c2-8d78-c696e9395e22 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:47.177418 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3da8be-8978-4867-8c44-f14ab5223e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:47.178004 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da8be-8978-4867-8c44-f14ab5223e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:47.178277 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da8be-8978-4867-8c44-f14ab5223e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:47.178544 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da8be-8978-4867-8c44-f14ab5223e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:47.179152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3da8be-8978-4867-8c44-f14ab5223e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:47.181063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3da8be-8978-4867-8c44-f14ab5223e7b admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:47.209384 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1403/2810] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:47 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:47.213490 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374237b4-4606-49e6-a9ce-dc6e1d76037b None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:47.223904 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374237b4-4606-49e6-a9ce-dc6e1d76037b None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:47.285307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d478d95-de6f-46da-a065-8b8020c50924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:47.285911 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d478d95-de6f-46da-a065-8b8020c50924 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:47.286183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d478d95-de6f-46da-a065-8b8020c50924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:47.286453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d478d95-de6f-46da-a065-8b8020c50924 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:47.287125 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d478d95-de6f-46da-a065-8b8020c50924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:47.289087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d478d95-de6f-46da-a065-8b8020c50924 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:47.315522 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1408/2811] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:47 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:47.318872 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3da8be-8978-4867-8c44-f14ab5223e7b admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:47.331497 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3da8be-8978-4867-8c44-f14ab5223e7b admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:47.336529 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5d518-19dd-45c2-b736-77fa89cab4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:47.337177 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5d518-19dd-45c2-b736-77fa89cab4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:47.337462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5d518-19dd-45c2-b736-77fa89cab4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:47.337759 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5d518-19dd-45c2-b736-77fa89cab4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:47.338453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5d518-19dd-45c2-b736-77fa89cab4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:47.339985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5d518-19dd-45c2-b736-77fa89cab4ff admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:47.357601 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1404/2812] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:47.361816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d478d95-de6f-46da-a065-8b8020c50924 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:47.372991 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d478d95-de6f-46da-a065-8b8020c50924 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:47.377629 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c0887-6126-4e4c-92cc-6a1c968d2c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:47.378271 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c0887-6126-4e4c-92cc-6a1c968d2c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:47.378544 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c0887-6126-4e4c-92cc-6a1c968d2c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:47.378814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c0887-6126-4e4c-92cc-6a1c968d2c53 admin admin] PATH_INFO: `/v3/projects/7de48755b7c84a0a84dffd60850871ce/users/76d9b3de39a442d08161cba31569208a/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:47.394071 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c0887-6126-4e4c-92cc-6a1c968d2c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de48755b7c84a0a84dffd60850871ce, user_id=76d9b3de39a442d08161cba31569208a, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:47.396734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c0887-6126-4e4c-92cc-6a1c968d2c53 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:47.411379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1409/2813] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:47 2022] PUT /identity/v3/projects/7de48755b7c84a0a84dffd60850871ce/users/76d9b3de39a442d08161cba31569208a/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:47.415332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5d518-19dd-45c2-b736-77fa89cab4ff admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:47.426683 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5d518-19dd-45c2-b736-77fa89cab4ff admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:47.478327 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:47.485370 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a50ff1-8d45-4cb8-92a4-1a401deaf84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:47.486009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50ff1-8d45-4cb8-92a4-1a401deaf84d admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:47.486464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50ff1-8d45-4cb8-92a4-1a401deaf84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:47.486950 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50ff1-8d45-4cb8-92a4-1a401deaf84d admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:47.487677 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a50ff1-8d45-4cb8-92a4-1a401deaf84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:47.489786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a50ff1-8d45-4cb8-92a4-1a401deaf84d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:47.500435 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1405/2814] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:30:47.504841 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c0887-6126-4e4c-92cc-6a1c968d2c53 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:47.516079 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c0887-6126-4e4c-92cc-6a1c968d2c53 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:47.520718 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41867-a252-420a-a53e-2708036d800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:47.521357 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41867-a252-420a-a53e-2708036d800e admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:47.521640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41867-a252-420a-a53e-2708036d800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:47.521923 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41867-a252-420a-a53e-2708036d800e admin admin] PATH_INFO: `/v3/projects/7de48755b7c84a0a84dffd60850871ce/users/76d9b3de39a442d08161cba31569208a/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:47.523826 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de41867-a252-420a-a53e-2708036d800e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de48755b7c84a0a84dffd60850871ce, user_id=76d9b3de39a442d08161cba31569208a, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:47.527065 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de41867-a252-420a-a53e-2708036d800e admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:47.537350 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1410/2815] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:47 2022] PUT /identity/v3/projects/7de48755b7c84a0a84dffd60850871ce/users/76d9b3de39a442d08161cba31569208a/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:47.547660 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b609d-8cfd-41c2-8516-dd864efb0265 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:47.547971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b609d-8cfd-41c2-8516-dd864efb0265 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:47.548240 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b609d-8cfd-41c2-8516-dd864efb0265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:47.576949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-e54b609d-8cfd-41c2-8516-dd864efb0265 None None] MFA Rules not processed for user `76d9b3de39a442d08161cba31569208a`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:47.578139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e54b609d-8cfd-41c2-8516-dd864efb0265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:47.645687 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1406/2816] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:30:47.657423 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41867-a252-420a-a53e-2708036d800e admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:47.659072 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-9de41867-a252-420a-a53e-2708036d800e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:47.707671 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:47.738573 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41867-a252-420a-a53e-2708036d800e admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:47.742106 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424dd5c-897f-4349-bac7-6014bb3e3884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:47.742690 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424dd5c-897f-4349-bac7-6014bb3e3884 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:47.742958 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424dd5c-897f-4349-bac7-6014bb3e3884 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:47.743222 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424dd5c-897f-4349-bac7-6014bb3e3884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:47.752555 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424dd5c-897f-4349-bac7-6014bb3e3884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:47.754007 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424dd5c-897f-4349-bac7-6014bb3e3884 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:47.763773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1411/2817] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:47.840665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b609d-8cfd-41c2-8516-dd864efb0265 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:47.850547 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b609d-8cfd-41c2-8516-dd864efb0265 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:47.854187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff719b9-4328-43c7-b05f-e37286b751a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:47.854772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff719b9-4328-43c7-b05f-e37286b751a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:47.855044 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff719b9-4328-43c7-b05f-e37286b751a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:47.855309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff719b9-4328-43c7-b05f-e37286b751a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:47.910921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff719b9-4328-43c7-b05f-e37286b751a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:47.912347 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff719b9-4328-43c7-b05f-e37286b751a6 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:47.922237 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1407/2818] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:54.676009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424dd5c-897f-4349-bac7-6014bb3e3884 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:54.736404 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424dd5c-897f-4349-bac7-6014bb3e3884 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:54.740913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:54.741526 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:54.741800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:54.742069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] PATH_INFO: `/v3/users/8382ee9554b34db7904416355d2e60b4` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:54.743167 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8382ee9554b34db7904416355d2e60b4)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:54.745385 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:54.789860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8382ee9554b34db7904416355d2e60b4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:54.797237 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8382ee9554b34db7904416355d2e60b4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:54.798011 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8382ee9554b34db7904416355d2e60b4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:54.798615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8382ee9554b34db7904416355d2e60b4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:54.805319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8382ee9554b34db7904416355d2e60b4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:54.822414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1412/2819] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:54 2022] DELETE /identity/v3/users/8382ee9554b34db7904416355d2e60b4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:54.826831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64875f57-2895-45ce-a871-6061b2647a07 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:54.827313 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64875f57-2895-45ce-a871-6061b2647a07 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:54.827424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64875f57-2895-45ce-a871-6061b2647a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:54.846703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-64875f57-2895-45ce-a871-6061b2647a07 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:54.847902 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-64875f57-2895-45ce-a871-6061b2647a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:54.904825 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1408/2820] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:54.914750 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:54.916367 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:54.968193 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:54.974459 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c173580-43de-47ca-92bb-e3caf07e94bc admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:54.978143 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8005f3f-68e4-46aa-8db7-f3158443d394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:54.978744 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8005f3f-68e4-46aa-8db7-f3158443d394 service neutron] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:54.979024 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8005f3f-68e4-46aa-8db7-f3158443d394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:54.979300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8005f3f-68e4-46aa-8db7-f3158443d394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:54.996814 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8005f3f-68e4-46aa-8db7-f3158443d394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:54.998241 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8005f3f-68e4-46aa-8db7-f3158443d394 service neutron] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:55.011745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1413/2821] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:55.289727 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64875f57-2895-45ce-a871-6061b2647a07 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:55.291761 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-64875f57-2895-45ce-a871-6061b2647a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:55.305694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64875f57-2895-45ce-a871-6061b2647a07 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:55.310556 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:55.311195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:55.311507 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:55.311777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] PATH_INFO: `/v3/projects/3bad43a42ca1409eb51f50298e9b5e25` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:55.312937 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bad43a42ca1409eb51f50298e9b5e25)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:55.315405 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:55.327695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:55.364058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bad43a42ca1409eb51f50298e9b5e25', 'request_id': 'req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.369822 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bad43a42ca1409eb51f50298e9b5e25', 'request_id': 'req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.383139 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bad43a42ca1409eb51f50298e9b5e25', 'request_id': 'req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.395600 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] The token cache is being invalidate because project 3bad43a42ca1409eb51f50298e9b5e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:55.395886 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.396530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.398043 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1409/2822] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:55 2022] DELETE /identity/v3/projects/3bad43a42ca1409eb51f50298e9b5e25 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:30:55.402813 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8005f3f-68e4-46aa-8db7-f3158443d394 service neutron] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:55.412417 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8005f3f-68e4-46aa-8db7-f3158443d394 service neutron] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:55.468272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:55.468917 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:55.469189 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:55.469453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] PATH_INFO: `/v3/users/76d9b3de39a442d08161cba31569208a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:55.470546 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d9b3de39a442d08161cba31569208a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:55.472447 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:55.517726 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d9b3de39a442d08161cba31569208a'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.526017 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d9b3de39a442d08161cba31569208a'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.526838 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d9b3de39a442d08161cba31569208a'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.527461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d9b3de39a442d08161cba31569208a'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.534307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-28c33287-f3e9-49e3-9d5a-dae3d60a2084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d9b3de39a442d08161cba31569208a'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.551443 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1414/2823] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:55 2022] DELETE /identity/v3/users/76d9b3de39a442d08161cba31569208a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:55.823810 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:55.825255 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:55.840684 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5837c-2a2a-4fbd-b292-5efcc3af94bd admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:55.898786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:55.899419 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:55.899710 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:55.900009 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] PATH_INFO: `/v3/projects/7de48755b7c84a0a84dffd60850871ce` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:55.901127 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de48755b7c84a0a84dffd60850871ce)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:55.903014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:55.949894 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de48755b7c84a0a84dffd60850871ce', 'request_id': 'req-3870aa7b-d1f8-42d6-8996-e1c28341645d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.955242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de48755b7c84a0a84dffd60850871ce', 'request_id': 'req-3870aa7b-d1f8-42d6-8996-e1c28341645d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.962599 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de48755b7c84a0a84dffd60850871ce', 'request_id': 'req-3870aa7b-d1f8-42d6-8996-e1c28341645d'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.973397 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] The token cache is being invalidate because project 7de48755b7c84a0a84dffd60850871ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:55.973697 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.974300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-3870aa7b-d1f8-42d6-8996-e1c28341645d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:55.975764 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1410/2824] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:55 2022] DELETE /identity/v3/projects/7de48755b7c84a0a84dffd60850871ce => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:30:55.981008 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e414a-5089-4965-b509-286ac0588871 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:55.981487 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e414a-5089-4965-b509-286ac0588871 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:55.981585 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e414a-5089-4965-b509-286ac0588871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.001232 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-5c5e414a-5089-4965-b509-286ac0588871 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:56.002454 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5c5e414a-5089-4965-b509-286ac0588871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:56.059856 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1415/2825] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:56.068877 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3ca8-ef9e-4c2e-95b5-4f72fbbb61bc None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.069158 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3ca8-ef9e-4c2e-95b5-4f72fbbb61bc None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.069432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3ca8-ef9e-4c2e-95b5-4f72fbbb61bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.089163 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-2bfa3ca8-ef9e-4c2e-95b5-4f72fbbb61bc None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:56.090353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-2bfa3ca8-ef9e-4c2e-95b5-4f72fbbb61bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:56.098160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1411/2826] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:56.102460 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e414a-5089-4965-b509-286ac0588871 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.112120 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e414a-5089-4965-b509-286ac0588871 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.116644 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1456ee-9367-4e20-b66f-a321282f09ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.117241 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1456ee-9367-4e20-b66f-a321282f09ed admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.117517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1456ee-9367-4e20-b66f-a321282f09ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.117781 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1456ee-9367-4e20-b66f-a321282f09ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.118961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1456ee-9367-4e20-b66f-a321282f09ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:30:56.119332 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1456ee-9367-4e20-b66f-a321282f09ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.120953 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1456ee-9367-4e20-b66f-a321282f09ed admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.123253 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:56.136679 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1416/2827] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:30:56.138725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa3ca8-ef9e-4c2e-95b5-4f72fbbb61bc None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.147916 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa3ca8-ef9e-4c2e-95b5-4f72fbbb61bc None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.152823 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99a58b-fd60-40ad-8c6c-afc86088c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.153413 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99a58b-fd60-40ad-8c6c-afc86088c360 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.153689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99a58b-fd60-40ad-8c6c-afc86088c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.153958 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99a58b-fd60-40ad-8c6c-afc86088c360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.154572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99a58b-fd60-40ad-8c6c-afc86088c360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.156446 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99a58b-fd60-40ad-8c6c-afc86088c360 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.183941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1412/2828] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:56 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:56.188070 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1456ee-9367-4e20-b66f-a321282f09ed admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.198900 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1456ee-9367-4e20-b66f-a321282f09ed admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.254864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b8ad3-0b4a-4c9b-959e-ba32045c9cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.255461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b8ad3-0b4a-4c9b-959e-ba32045c9cfc admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.255739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b8ad3-0b4a-4c9b-959e-ba32045c9cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.256008 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b8ad3-0b4a-4c9b-959e-ba32045c9cfc admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.256654 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b8ad3-0b4a-4c9b-959e-ba32045c9cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.258570 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b8ad3-0b4a-4c9b-959e-ba32045c9cfc admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.279572 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1417/2829] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:56 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:30:56.283699 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99a58b-fd60-40ad-8c6c-afc86088c360 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.289122 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:56.296292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99a58b-fd60-40ad-8c6c-afc86088c360 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.302058 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a372f6d-9093-44b3-a25e-2532f7d4e7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.302774 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a372f6d-9093-44b3-a25e-2532f7d4e7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.303081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a372f6d-9093-44b3-a25e-2532f7d4e7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.303356 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a372f6d-9093-44b3-a25e-2532f7d4e7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.303992 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a372f6d-9093-44b3-a25e-2532f7d4e7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.305623 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a372f6d-9093-44b3-a25e-2532f7d4e7b4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.316300 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1413/2830] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:56.320136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b8ad3-0b4a-4c9b-959e-ba32045c9cfc admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.331276 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b8ad3-0b4a-4c9b-959e-ba32045c9cfc admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.335866 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2a4b4-2338-4447-8523-94b45745c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.336452 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2a4b4-2338-4447-8523-94b45745c9ac admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.336767 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2a4b4-2338-4447-8523-94b45745c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.337494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2a4b4-2338-4447-8523-94b45745c9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.338140 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2a4b4-2338-4447-8523-94b45745c9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.339742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2a4b4-2338-4447-8523-94b45745c9ac admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.350246 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1418/2831] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:56.355026 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a372f6d-9093-44b3-a25e-2532f7d4e7b4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.364955 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a372f6d-9093-44b3-a25e-2532f7d4e7b4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.370264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321210e-4dee-4aff-b255-e26fdb65c7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.370908 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321210e-4dee-4aff-b255-e26fdb65c7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.371188 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321210e-4dee-4aff-b255-e26fdb65c7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.371464 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321210e-4dee-4aff-b255-e26fdb65c7ae admin admin] PATH_INFO: `/v3/projects/b97c3a6f13f6404cb1f4f0fed37c5ef6/users/c3fa0561162e4f0c82e12a43ae87c3d9/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.385737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321210e-4dee-4aff-b255-e26fdb65c7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97c3a6f13f6404cb1f4f0fed37c5ef6, user_id=c3fa0561162e4f0c82e12a43ae87c3d9, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.388377 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321210e-4dee-4aff-b255-e26fdb65c7ae admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.401669 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1414/2832] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:56 2022] PUT /identity/v3/projects/b97c3a6f13f6404cb1f4f0fed37c5ef6/users/c3fa0561162e4f0c82e12a43ae87c3d9/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:56.412025 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c435ac7-067b-4dd6-8b58-9c9946c04e8d None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.412306 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c435ac7-067b-4dd6-8b58-9c9946c04e8d None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.412594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c435ac7-067b-4dd6-8b58-9c9946c04e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.440970 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-8c435ac7-067b-4dd6-8b58-9c9946c04e8d None None] MFA Rules not processed for user `c3fa0561162e4f0c82e12a43ae87c3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:56.442156 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8c435ac7-067b-4dd6-8b58-9c9946c04e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:56.505109 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1419/2833] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:56.509907 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321210e-4dee-4aff-b255-e26fdb65c7ae admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.573436 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321210e-4dee-4aff-b255-e26fdb65c7ae admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.578883 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ef9be-6f5a-4d19-adbc-bc7f952509b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.579498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ef9be-6f5a-4d19-adbc-bc7f952509b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.579777 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ef9be-6f5a-4d19-adbc-bc7f952509b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.580054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ef9be-6f5a-4d19-adbc-bc7f952509b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.580705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ef9be-6f5a-4d19-adbc-bc7f952509b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.582604 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ef9be-6f5a-4d19-adbc-bc7f952509b8 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.609181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1415/2834] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:56 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:30:56.613317 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c435ac7-067b-4dd6-8b58-9c9946c04e8d None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.624498 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c435ac7-067b-4dd6-8b58-9c9946c04e8d None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.678834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce4603-1ec9-4384-b2c9-0c62e5a43f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.679427 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce4603-1ec9-4384-b2c9-0c62e5a43f85 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.679700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce4603-1ec9-4384-b2c9-0c62e5a43f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.679961 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce4603-1ec9-4384-b2c9-0c62e5a43f85 admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.680574 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce4603-1ec9-4384-b2c9-0c62e5a43f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.682494 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce4603-1ec9-4384-b2c9-0c62e5a43f85 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.692041 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:56.704361 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1420/2835] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:56 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:30:56.708451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ef9be-6f5a-4d19-adbc-bc7f952509b8 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.719296 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ef9be-6f5a-4d19-adbc-bc7f952509b8 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.723827 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42858ef-9eaf-4a91-981a-dff3d85e7d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.724412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42858ef-9eaf-4a91-981a-dff3d85e7d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.724717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42858ef-9eaf-4a91-981a-dff3d85e7d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.724988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42858ef-9eaf-4a91-981a-dff3d85e7d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.725614 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42858ef-9eaf-4a91-981a-dff3d85e7d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.727189 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42858ef-9eaf-4a91-981a-dff3d85e7d41 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.738274 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1416/2836] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:56.742094 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce4603-1ec9-4384-b2c9-0c62e5a43f85 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.752198 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce4603-1ec9-4384-b2c9-0c62e5a43f85 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.756745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4964b-849c-489c-b459-fd297fa82a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.757323 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4964b-849c-489c-b459-fd297fa82a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.757596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4964b-849c-489c-b459-fd297fa82a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.757861 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4964b-849c-489c-b459-fd297fa82a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.758480 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4964b-849c-489c-b459-fd297fa82a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.760216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4964b-849c-489c-b459-fd297fa82a4c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.769868 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1421/2837] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:56.773729 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42858ef-9eaf-4a91-981a-dff3d85e7d41 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.784117 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42858ef-9eaf-4a91-981a-dff3d85e7d41 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.788648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f1a28-64ff-4fc7-8828-24f85e0010b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.789293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f1a28-64ff-4fc7-8828-24f85e0010b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.789570 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f1a28-64ff-4fc7-8828-24f85e0010b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.789842 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f1a28-64ff-4fc7-8828-24f85e0010b7 admin admin] PATH_INFO: `/v3/projects/0f7b751f55674be0ad28fedd6a451e3a/users/3bb6ad70ed1a4ef8a246ed053534955f/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.804925 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f1a28-64ff-4fc7-8828-24f85e0010b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7b751f55674be0ad28fedd6a451e3a, user_id=3bb6ad70ed1a4ef8a246ed053534955f, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.807597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f1a28-64ff-4fc7-8828-24f85e0010b7 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:56.820052 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1417/2838] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:56 2022] PUT /identity/v3/projects/0f7b751f55674be0ad28fedd6a451e3a/users/3bb6ad70ed1a4ef8a246ed053534955f/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:30:56.830668 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37825dd7-0290-4169-845b-e311d12886f6 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.830870 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37825dd7-0290-4169-845b-e311d12886f6 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.831136 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37825dd7-0290-4169-845b-e311d12886f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.859090 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-37825dd7-0290-4169-845b-e311d12886f6 None None] MFA Rules not processed for user `3bb6ad70ed1a4ef8a246ed053534955f`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:56.860304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-37825dd7-0290-4169-845b-e311d12886f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:56.924681 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1422/2839] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:56.929157 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f1a28-64ff-4fc7-8828-24f85e0010b7 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:56.990881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f1a28-64ff-4fc7-8828-24f85e0010b7 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:56.996000 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee87e-717a-4f34-9ae5-e810b0aa2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:56.996598 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee87e-717a-4f34-9ae5-e810b0aa2166 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:56.996906 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee87e-717a-4f34-9ae5-e810b0aa2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:56.997179 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee87e-717a-4f34-9ae5-e810b0aa2166 admin admin] PATH_INFO: `/v3/projects` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:56.997805 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ee87e-717a-4f34-9ae5-e810b0aa2166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:56.999696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ee87e-717a-4f34-9ae5-e810b0aa2166 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:57.026453 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1418/2840] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:56 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:30:57.030493 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37825dd7-0290-4169-845b-e311d12886f6 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:57.041362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37825dd7-0290-4169-845b-e311d12886f6 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:57.096336 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b1fa7-403d-4afc-be91-30ece919694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:57.096956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b1fa7-403d-4afc-be91-30ece919694a admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:57.097236 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b1fa7-403d-4afc-be91-30ece919694a admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:57.097506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b1fa7-403d-4afc-be91-30ece919694a admin admin] PATH_INFO: `/v3/users` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:57.098115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b1fa7-403d-4afc-be91-30ece919694a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:57.100049 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b1fa7-403d-4afc-be91-30ece919694a admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:57.121079 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1423/2841] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:57 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:57.125242 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee87e-717a-4f34-9ae5-e810b0aa2166 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:57.130771 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:57.137909 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee87e-717a-4f34-9ae5-e810b0aa2166 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:57.142873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867fd5d-7eef-45ad-9513-4c24d15465ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:57.143566 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867fd5d-7eef-45ad-9513-4c24d15465ec admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:57.143854 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867fd5d-7eef-45ad-9513-4c24d15465ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:57.144113 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867fd5d-7eef-45ad-9513-4c24d15465ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:57.144779 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867fd5d-7eef-45ad-9513-4c24d15465ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:57.146367 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867fd5d-7eef-45ad-9513-4c24d15465ec admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:57.157781 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1419/2842] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:57.161723 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b1fa7-403d-4afc-be91-30ece919694a admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:57.171833 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b1fa7-403d-4afc-be91-30ece919694a admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:57.176362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93121f27-eb86-4ee1-983b-71063f4f6617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:57.177021 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93121f27-eb86-4ee1-983b-71063f4f6617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:57.177295 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93121f27-eb86-4ee1-983b-71063f4f6617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:57.177560 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93121f27-eb86-4ee1-983b-71063f4f6617 admin admin] PATH_INFO: `/v3/projects/e6ee9bcab7d649e19e2007d80862ae31/users/e1bdae2c528348b09dad3fe70c1aab74/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:57.191745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93121f27-eb86-4ee1-983b-71063f4f6617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ee9bcab7d649e19e2007d80862ae31, user_id=e1bdae2c528348b09dad3fe70c1aab74, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:57.194401 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93121f27-eb86-4ee1-983b-71063f4f6617 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:57.208950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1424/2843] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:57 2022] PUT /identity/v3/projects/e6ee9bcab7d649e19e2007d80862ae31/users/e1bdae2c528348b09dad3fe70c1aab74/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:57.213045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867fd5d-7eef-45ad-9513-4c24d15465ec admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:57.223647 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867fd5d-7eef-45ad-9513-4c24d15465ec admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:57.279349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5f0ea-bfee-45f3-bea3-011f5f759981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:57.279946 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5f0ea-bfee-45f3-bea3-011f5f759981 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:57.280217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5f0ea-bfee-45f3-bea3-011f5f759981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:57.280479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5f0ea-bfee-45f3-bea3-011f5f759981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:57.281133 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5f0ea-bfee-45f3-bea3-011f5f759981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:57.282700 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5f0ea-bfee-45f3-bea3-011f5f759981 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:57.292714 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1420/2844] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:57.297129 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93121f27-eb86-4ee1-983b-71063f4f6617 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:57.308085 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93121f27-eb86-4ee1-983b-71063f4f6617 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:57.312699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cbd0b-cfaf-4d5c-90dc-3f37c0265e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:57.313333 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cbd0b-cfaf-4d5c-90dc-3f37c0265e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:57.313604 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cbd0b-cfaf-4d5c-90dc-3f37c0265e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:57.313871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cbd0b-cfaf-4d5c-90dc-3f37c0265e8b admin admin] PATH_INFO: `/v3/projects/e6ee9bcab7d649e19e2007d80862ae31/users/e1bdae2c528348b09dad3fe70c1aab74/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:57.315751 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cbd0b-cfaf-4d5c-90dc-3f37c0265e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ee9bcab7d649e19e2007d80862ae31, user_id=e1bdae2c528348b09dad3fe70c1aab74, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:57.318443 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cbd0b-cfaf-4d5c-90dc-3f37c0265e8b admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:57.329992 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1425/2845] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:57 2022] PUT /identity/v3/projects/e6ee9bcab7d649e19e2007d80862ae31/users/e1bdae2c528348b09dad3fe70c1aab74/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:57.399959 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5465b-d3c4-4a85-a641-6e3bbdee2eb8 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:57.400321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5465b-d3c4-4a85-a641-6e3bbdee2eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:57.400695 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5465b-d3c4-4a85-a641-6e3bbdee2eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:57.428834 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f8c5465b-d3c4-4a85-a641-6e3bbdee2eb8 None None] MFA Rules not processed for user `e1bdae2c528348b09dad3fe70c1aab74`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:57.430073 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f8c5465b-d3c4-4a85-a641-6e3bbdee2eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:57.497424 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1421/2846] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:30:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:57.508716 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cbd0b-cfaf-4d5c-90dc-3f37c0265e8b admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:57.511202 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ec4cbd0b-cfaf-4d5c-90dc-3f37c0265e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:57.538764 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:57.569257 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cbd0b-cfaf-4d5c-90dc-3f37c0265e8b admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:57.573739 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f57342-4f7b-4414-b1cc-67c51966fd11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:57.574381 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f57342-4f7b-4414-b1cc-67c51966fd11 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:57.574653 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f57342-4f7b-4414-b1cc-67c51966fd11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:57.574915 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f57342-4f7b-4414-b1cc-67c51966fd11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:57.583629 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f57342-4f7b-4414-b1cc-67c51966fd11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:57.585092 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f57342-4f7b-4414-b1cc-67c51966fd11 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:57.594663 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1426/2847] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:58.083597 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5465b-d3c4-4a85-a641-6e3bbdee2eb8 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:58.085042 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f8c5465b-d3c4-4a85-a641-6e3bbdee2eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:58.096970 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5465b-d3c4-4a85-a641-6e3bbdee2eb8 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:58.100498 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b44dd1-d917-4fd9-a805-63ee014600d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:58.101115 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44dd1-d917-4fd9-a805-63ee014600d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:58.101412 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44dd1-d917-4fd9-a805-63ee014600d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:58.101678 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44dd1-d917-4fd9-a805-63ee014600d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:58.157832 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b44dd1-d917-4fd9-a805-63ee014600d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:58.159264 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b44dd1-d917-4fd9-a805-63ee014600d3 service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:58.169054 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1422/2848] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:02.153272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f57342-4f7b-4414-b1cc-67c51966fd11 service cinder] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:02.162113 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f57342-4f7b-4414-b1cc-67c51966fd11 service cinder] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:02.166655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afdb52-ed7d-44b0-b4a3-c1c1cc609f87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:02.167272 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afdb52-ed7d-44b0-b4a3-c1c1cc609f87 service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:02.167549 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afdb52-ed7d-44b0-b4a3-c1c1cc609f87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:02.167816 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afdb52-ed7d-44b0-b4a3-c1c1cc609f87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:02.223973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afdb52-ed7d-44b0-b4a3-c1c1cc609f87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:02.225446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afdb52-ed7d-44b0-b4a3-c1c1cc609f87 service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:02.234800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1427/2849] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:04.292346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b44dd1-d917-4fd9-a805-63ee014600d3 service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:04.304938 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=100 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:04.358369 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b44dd1-d917-4fd9-a805-63ee014600d3 service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:04.362985 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:04.363602 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:04.363879 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:04.364152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] PATH_INFO: `/v3/users/c3fa0561162e4f0c82e12a43ae87c3d9` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:04.365275 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fa0561162e4f0c82e12a43ae87c3d9)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:04.367175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:04.420941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fa0561162e4f0c82e12a43ae87c3d9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:04.429451 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fa0561162e4f0c82e12a43ae87c3d9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:04.430170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fa0561162e4f0c82e12a43ae87c3d9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:04.430789 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fa0561162e4f0c82e12a43ae87c3d9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:04.443899 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fa0561162e4f0c82e12a43ae87c3d9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:04.470208 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1423/2850] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:31:04 2022] DELETE /identity/v3/users/c3fa0561162e4f0c82e12a43ae87c3d9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:04.474760 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8d5f-6c08-41c7-96eb-3871a7e0d490 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:04.475265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8d5f-6c08-41c7-96eb-3871a7e0d490 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:04.475428 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8d5f-6c08-41c7-96eb-3871a7e0d490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:04.499571 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-e68f8d5f-6c08-41c7-96eb-3871a7e0d490 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:04.500821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e68f8d5f-6c08-41c7-96eb-3871a7e0d490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:04.568314 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1428/2851] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:04.578961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:04.580381 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:04.641181 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f80354-d8d2-4db0-9721-b7e0c8a50f99 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:04.644885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049443a3-b553-4034-8225-50479704dc7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:04.645500 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049443a3-b553-4034-8225-50479704dc7b service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:04.645778 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049443a3-b553-4034-8225-50479704dc7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:04.646047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049443a3-b553-4034-8225-50479704dc7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:04.656849 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049443a3-b553-4034-8225-50479704dc7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:04.658287 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049443a3-b553-4034-8225-50479704dc7b service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:04.668766 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1424/2852] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:04.963182 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f8d5f-6c08-41c7-96eb-3871a7e0d490 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:04.964683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-e68f8d5f-6c08-41c7-96eb-3871a7e0d490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:04.977242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f8d5f-6c08-41c7-96eb-3871a7e0d490 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:04.983786 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:04.984437 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:04.985399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:04.985399 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] PATH_INFO: `/v3/projects/b97c3a6f13f6404cb1f4f0fed37c5ef6` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:04.986150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97c3a6f13f6404cb1f4f0fed37c5ef6)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:04.988068 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:05.041105 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97c3a6f13f6404cb1f4f0fed37c5ef6', 'request_id': 'req-8895a2e7-7746-4eee-874a-987c15ac05cd'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.046865 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97c3a6f13f6404cb1f4f0fed37c5ef6', 'request_id': 'req-8895a2e7-7746-4eee-874a-987c15ac05cd'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.050056 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:05.055031 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97c3a6f13f6404cb1f4f0fed37c5ef6', 'request_id': 'req-8895a2e7-7746-4eee-874a-987c15ac05cd'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.068821 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] The token cache is being invalidate because project b97c3a6f13f6404cb1f4f0fed37c5ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:31:05.069104 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.069773 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.072037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1429/2853] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:31:04 2022] DELETE /identity/v3/projects/b97c3a6f13f6404cb1f4f0fed37c5ef6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:05.076047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049443a3-b553-4034-8225-50479704dc7b service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:05.085882 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049443a3-b553-4034-8225-50479704dc7b service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:05.127072 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:05.157534 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:05.158190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:05.158465 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:05.158731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] PATH_INFO: `/v3/users/3bb6ad70ed1a4ef8a246ed053534955f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:05.159906 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb6ad70ed1a4ef8a246ed053534955f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:05.161844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:05.216153 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb6ad70ed1a4ef8a246ed053534955f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.223518 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb6ad70ed1a4ef8a246ed053534955f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.224265 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb6ad70ed1a4ef8a246ed053534955f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.224887 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb6ad70ed1a4ef8a246ed053534955f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.232384 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb6ad70ed1a4ef8a246ed053534955f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.250233 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1425/2854] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:31:05 2022] DELETE /identity/v3/users/3bb6ad70ed1a4ef8a246ed053534955f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:05.536388 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:05.537950 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:05.552444 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a2e7-7746-4eee-874a-987c15ac05cd admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:05.612464 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:05.613069 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:05.613342 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:05.613607 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] PATH_INFO: `/v3/projects/0f7b751f55674be0ad28fedd6a451e3a` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:05.614731 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7b751f55674be0ad28fedd6a451e3a)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:05.616717 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:05.662800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7b751f55674be0ad28fedd6a451e3a', 'request_id': 'req-93695d28-ed72-4535-b50f-819d3ee8bcf4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.669171 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7b751f55674be0ad28fedd6a451e3a', 'request_id': 'req-93695d28-ed72-4535-b50f-819d3ee8bcf4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.676473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7b751f55674be0ad28fedd6a451e3a', 'request_id': 'req-93695d28-ed72-4535-b50f-819d3ee8bcf4'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.687266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] The token cache is being invalidate because project 0f7b751f55674be0ad28fedd6a451e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:31:05.687551 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.688173 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.689683 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1430/2855] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:31:05 2022] DELETE /identity/v3/projects/0f7b751f55674be0ad28fedd6a451e3a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:05.693753 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:05.695170 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:05.708585 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab6262-c686-4745-ba8b-c1d35a8338b1 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:05.765772 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:05.766396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:05.766674 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:05.766954 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] PATH_INFO: `/v3/users/e1bdae2c528348b09dad3fe70c1aab74` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:05.768045 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1bdae2c528348b09dad3fe70c1aab74)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:05.769979 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:05.815012 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1bdae2c528348b09dad3fe70c1aab74'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.820191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:05.822417 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1bdae2c528348b09dad3fe70c1aab74'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.823385 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1bdae2c528348b09dad3fe70c1aab74'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.824281 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1bdae2c528348b09dad3fe70c1aab74'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.831671 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-cbe7495b-d4cc-4d07-bbe9-7155b69610f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1bdae2c528348b09dad3fe70c1aab74'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:05.848880 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1426/2856] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:31:05 2022] DELETE /identity/v3/users/e1bdae2c528348b09dad3fe70c1aab74 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:06.122446 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:06.124035 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:06.137677 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93695d28-ed72-4535-b50f-819d3ee8bcf4 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:06.195102 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:06.195734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.196009 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.196307 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] PATH_INFO: `/v3/projects/e6ee9bcab7d649e19e2007d80862ae31` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.197521 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ee9bcab7d649e19e2007d80862ae31)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:06.199531 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:06.222204 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:06.246461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ee9bcab7d649e19e2007d80862ae31', 'request_id': 'req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:06.251759 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ee9bcab7d649e19e2007d80862ae31', 'request_id': 'req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:06.259045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ee9bcab7d649e19e2007d80862ae31', 'request_id': 'req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:06.270050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] The token cache is being invalidate because project e6ee9bcab7d649e19e2007d80862ae31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:31:06.270343 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:06.270973 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-29e84bfc-4d80-4dbf-8481-6a8b2864bba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:06.272455 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1431/2857] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:31:06 2022] DELETE /identity/v3/projects/e6ee9bcab7d649e19e2007d80862ae31 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:06.278430 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaeab8-8848-4870-a738-0a2a43489c52 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.278717 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaeab8-8848-4870-a738-0a2a43489c52 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.278989 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaeab8-8848-4870-a738-0a2a43489c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.298988 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-cdaaeab8-8848-4870-a738-0a2a43489c52 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:06.300182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-cdaaeab8-8848-4870-a738-0a2a43489c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:06.359694 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1427/2858] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:06.368999 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d5501-cdef-4966-b14c-e0d5af6148be None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.369296 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d5501-cdef-4966-b14c-e0d5af6148be None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.369566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d5501-cdef-4966-b14c-e0d5af6148be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.388854 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-c20d5501-cdef-4966-b14c-e0d5af6148be None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:06.390043 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-c20d5501-cdef-4966-b14c-e0d5af6148be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:06.398183 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1432/2859] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:06.402972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaeab8-8848-4870-a738-0a2a43489c52 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:06.413074 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaeab8-8848-4870-a738-0a2a43489c52 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:06.418491 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827190e7-d357-4f84-8288-6f674ac1de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:06.419089 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827190e7-d357-4f84-8288-6f674ac1de30 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.419363 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827190e7-d357-4f84-8288-6f674ac1de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.419631 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827190e7-d357-4f84-8288-6f674ac1de30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.420527 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827190e7-d357-4f84-8288-6f674ac1de30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:31:06.420862 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827190e7-d357-4f84-8288-6f674ac1de30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:06.422447 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827190e7-d357-4f84-8288-6f674ac1de30 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:06.434390 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1428/2860] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:31:06.438708 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d5501-cdef-4966-b14c-e0d5af6148be None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:06.448063 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d5501-cdef-4966-b14c-e0d5af6148be None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:06.452729 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97131fd-906e-466e-81ea-441677c25204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:06.453319 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97131fd-906e-466e-81ea-441677c25204 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.453594 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97131fd-906e-466e-81ea-441677c25204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.453862 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97131fd-906e-466e-81ea-441677c25204 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.454481 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97131fd-906e-466e-81ea-441677c25204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:06.456379 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97131fd-906e-466e-81ea-441677c25204 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:06.483903 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1433/2861] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:31:06 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:31:06.488100 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827190e7-d357-4f84-8288-6f674ac1de30 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:06.498743 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827190e7-d357-4f84-8288-6f674ac1de30 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:06.553396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc643bb-5678-477c-889e-005e8e32e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:06.553987 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc643bb-5678-477c-889e-005e8e32e4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.554263 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc643bb-5678-477c-889e-005e8e32e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.554530 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc643bb-5678-477c-889e-005e8e32e4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.555136 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc643bb-5678-477c-889e-005e8e32e4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:06.557572 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc643bb-5678-477c-889e-005e8e32e4e2 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:06.581396 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1429/2862] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:31:06 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:31:06.585615 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97131fd-906e-466e-81ea-441677c25204 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:06.596483 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97131fd-906e-466e-81ea-441677c25204 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:06.601110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf75d7-7a7a-402e-8fab-6002268499cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:06.601700 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf75d7-7a7a-402e-8fab-6002268499cd admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.601975 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf75d7-7a7a-402e-8fab-6002268499cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.602242 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf75d7-7a7a-402e-8fab-6002268499cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.603613 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf75d7-7a7a-402e-8fab-6002268499cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:06.605422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf75d7-7a7a-402e-8fab-6002268499cd admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:06.615566 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1434/2863] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:31:06.620110 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc643bb-5678-477c-889e-005e8e32e4e2 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:06.630037 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc643bb-5678-477c-889e-005e8e32e4e2 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:06.634782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f9e9b-b055-4ea3-8270-d5bb5b87daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:06.635372 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f9e9b-b055-4ea3-8270-d5bb5b87daf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.635648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f9e9b-b055-4ea3-8270-d5bb5b87daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.635921 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f9e9b-b055-4ea3-8270-d5bb5b87daf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.636555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f9e9b-b055-4ea3-8270-d5bb5b87daf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:06.638191 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f9e9b-b055-4ea3-8270-d5bb5b87daf0 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:06.648696 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1430/2864] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:31:06.653151 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf75d7-7a7a-402e-8fab-6002268499cd admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:06.668248 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf75d7-7a7a-402e-8fab-6002268499cd admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:06.673569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5e61b-a054-448e-8653-391ddf6e81ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:06.674209 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5e61b-a054-448e-8653-391ddf6e81ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.674485 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5e61b-a054-448e-8653-391ddf6e81ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.674784 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5e61b-a054-448e-8653-391ddf6e81ae admin admin] PATH_INFO: `/v3/projects/2846a4b941b1469cbbc28778dd72175f/users/2441110a92b34e08ab6c50574dcad9eb/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.689612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5e61b-a054-448e-8653-391ddf6e81ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2846a4b941b1469cbbc28778dd72175f, user_id=2441110a92b34e08ab6c50574dcad9eb, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:06.692230 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5e61b-a054-448e-8653-391ddf6e81ae admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:06.704996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1435/2865] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:31:06 2022] PUT /identity/v3/projects/2846a4b941b1469cbbc28778dd72175f/users/2441110a92b34e08ab6c50574dcad9eb/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:06.718754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97319e10-cbf3-48ef-83cc-586fa9aea134 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.719249 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97319e10-cbf3-48ef-83cc-586fa9aea134 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.719348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97319e10-cbf3-48ef-83cc-586fa9aea134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.747106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-97319e10-cbf3-48ef-83cc-586fa9aea134 None None] MFA Rules not processed for user `2441110a92b34e08ab6c50574dcad9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:06.748312 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-97319e10-cbf3-48ef-83cc-586fa9aea134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:06.775182 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:06.814391 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1431/2866] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:06.818952 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5e61b-a054-448e-8653-391ddf6e81ae admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:06.879389 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5e61b-a054-448e-8653-391ddf6e81ae admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:06.885098 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b74e-86ef-455c-b3b9-6f6d0f6c355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:06.885783 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b74e-86ef-455c-b3b9-6f6d0f6c355c admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.886030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b74e-86ef-455c-b3b9-6f6d0f6c355c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.886300 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b74e-86ef-455c-b3b9-6f6d0f6c355c admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.886983 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528b74e-86ef-455c-b3b9-6f6d0f6c355c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:06.888912 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528b74e-86ef-455c-b3b9-6f6d0f6c355c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:06.916325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1436/2867] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:31:06 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:31:06.920685 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97319e10-cbf3-48ef-83cc-586fa9aea134 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:06.932288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97319e10-cbf3-48ef-83cc-586fa9aea134 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:06.987593 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3378a6-503b-4602-9e8b-5d9e0262530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:06.988196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3378a6-503b-4602-9e8b-5d9e0262530c admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.988472 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3378a6-503b-4602-9e8b-5d9e0262530c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.988782 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3378a6-503b-4602-9e8b-5d9e0262530c admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.989437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3378a6-503b-4602-9e8b-5d9e0262530c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:06.991332 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3378a6-503b-4602-9e8b-5d9e0262530c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:07.015378 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1432/2868] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:31:06 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:31:07.019413 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b74e-86ef-455c-b3b9-6f6d0f6c355c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:07.029993 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b74e-86ef-455c-b3b9-6f6d0f6c355c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:07.034569 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c44f6d-5877-47b9-8d39-cc36c263761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:07.035158 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c44f6d-5877-47b9-8d39-cc36c263761c admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:07.035433 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c44f6d-5877-47b9-8d39-cc36c263761c admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:07.035699 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c44f6d-5877-47b9-8d39-cc36c263761c admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:07.036325 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c44f6d-5877-47b9-8d39-cc36c263761c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:07.037957 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c44f6d-5877-47b9-8d39-cc36c263761c admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:07.049506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1437/2869] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:31:07.053499 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3378a6-503b-4602-9e8b-5d9e0262530c admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:07.064437 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3378a6-503b-4602-9e8b-5d9e0262530c admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:07.069014 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dddc2-87e9-4bd1-badb-077d61e88d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:07.069648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dddc2-87e9-4bd1-badb-077d61e88d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:07.069923 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dddc2-87e9-4bd1-badb-077d61e88d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:07.070196 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dddc2-87e9-4bd1-badb-077d61e88d42 admin admin] PATH_INFO: `/v3/projects/e2306aa4c4174391abc23a20c4d4ac67/users/b2b07878b21e4f10b57f60942921d5f9/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:07.085036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36dddc2-87e9-4bd1-badb-077d61e88d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2306aa4c4174391abc23a20c4d4ac67, user_id=b2b07878b21e4f10b57f60942921d5f9, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:07.088479 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36dddc2-87e9-4bd1-badb-077d61e88d42 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:07.101336 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1433/2870] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:31:07 2022] PUT /identity/v3/projects/e2306aa4c4174391abc23a20c4d4ac67/users/b2b07878b21e4f10b57f60942921d5f9/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:07.106258 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c44f6d-5877-47b9-8d39-cc36c263761c admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:07.116199 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c44f6d-5877-47b9-8d39-cc36c263761c admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:07.133362 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:07.176045 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cbbe7-e02d-4ed5-9072-cd72546bf4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:07.176669 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cbbe7-e02d-4ed5-9072-cd72546bf4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:07.176948 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cbbe7-e02d-4ed5-9072-cd72546bf4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:07.177216 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cbbe7-e02d-4ed5-9072-cd72546bf4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:07.177844 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cbbe7-e02d-4ed5-9072-cd72546bf4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:07.179426 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cbbe7-e02d-4ed5-9072-cd72546bf4b3 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:07.189082 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1438/2871] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:31:07.193197 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dddc2-87e9-4bd1-badb-077d61e88d42 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:07.203832 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dddc2-87e9-4bd1-badb-077d61e88d42 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:07.209156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436984b-3caf-4fa2-8ad3-e2714fa73d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:07.209802 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436984b-3caf-4fa2-8ad3-e2714fa73d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:07.210081 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436984b-3caf-4fa2-8ad3-e2714fa73d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:07.210354 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436984b-3caf-4fa2-8ad3-e2714fa73d45 admin admin] PATH_INFO: `/v3/projects/e2306aa4c4174391abc23a20c4d4ac67/users/b2b07878b21e4f10b57f60942921d5f9/roles/d6155b01aace49f887f29aa2861d31cf` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:07.212844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436984b-3caf-4fa2-8ad3-e2714fa73d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2306aa4c4174391abc23a20c4d4ac67, user_id=b2b07878b21e4f10b57f60942921d5f9, role_id=d6155b01aace49f887f29aa2861d31cf)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:07.215460 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436984b-3caf-4fa2-8ad3-e2714fa73d45 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:07.225808 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1434/2872] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:31:07 2022] PUT /identity/v3/projects/e2306aa4c4174391abc23a20c4d4ac67/users/b2b07878b21e4f10b57f60942921d5f9/roles/d6155b01aace49f887f29aa2861d31cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:31:07.236499 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97288a-9cb1-4db1-b32e-873318ab4a36 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:07.236811 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97288a-9cb1-4db1-b32e-873318ab4a36 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:07.237110 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97288a-9cb1-4db1-b32e-873318ab4a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:07.263887 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-ab97288a-9cb1-4db1-b32e-873318ab4a36 None None] MFA Rules not processed for user `b2b07878b21e4f10b57f60942921d5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:07.265126 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ab97288a-9cb1-4db1-b32e-873318ab4a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:07.333606 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1439/2873] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:07.345029 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436984b-3caf-4fa2-8ad3-e2714fa73d45 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:07.346809 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-1436984b-3caf-4fa2-8ad3-e2714fa73d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:07.410272 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436984b-3caf-4fa2-8ad3-e2714fa73d45 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:07.414322 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1d187-cf55-4338-84a9-2fa1192b968a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:07.414966 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1d187-cf55-4338-84a9-2fa1192b968a service cinder] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:07.415288 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1d187-cf55-4338-84a9-2fa1192b968a service cinder] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:07.415563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1d187-cf55-4338-84a9-2fa1192b968a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:07.449039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:07.473440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1d187-cf55-4338-84a9-2fa1192b968a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:07.474888 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1d187-cf55-4338-84a9-2fa1192b968a service cinder] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:07.483705 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1435/2874] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:11.674617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97288a-9cb1-4db1-b32e-873318ab4a36 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:11.676050 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-ab97288a-9cb1-4db1-b32e-873318ab4a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:11.688587 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97288a-9cb1-4db1-b32e-873318ab4a36 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:11.692128 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6834c-a5f3-436c-a61b-5a12e23728eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:11.692746 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6834c-a5f3-436c-a61b-5a12e23728eb service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:11.693023 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6834c-a5f3-436c-a61b-5a12e23728eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:11.693288 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6834c-a5f3-436c-a61b-5a12e23728eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:11.703087 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6834c-a5f3-436c-a61b-5a12e23728eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:11.704510 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6834c-a5f3-436c-a61b-5a12e23728eb service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:11.713823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1440/2875] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:16.589120 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1d187-cf55-4338-84a9-2fa1192b968a service cinder] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:16.650980 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1d187-cf55-4338-84a9-2fa1192b968a service cinder] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:16.655725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:16.656353 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:16.656640 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:16.656941 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] PATH_INFO: `/v3/users/2441110a92b34e08ab6c50574dcad9eb` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:16.658063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2441110a92b34e08ab6c50574dcad9eb)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:16.660024 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:16.704576 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2441110a92b34e08ab6c50574dcad9eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:16.711202 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2441110a92b34e08ab6c50574dcad9eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:16.711846 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2441110a92b34e08ab6c50574dcad9eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:16.713091 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2441110a92b34e08ab6c50574dcad9eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:16.721073 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2441110a92b34e08ab6c50574dcad9eb'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:16.738039 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1436/2876] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:31:16 2022] DELETE /identity/v3/users/2441110a92b34e08ab6c50574dcad9eb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:31:16.742453 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133b13-dff6-495e-b620-64c7880a199e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:16.742916 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133b13-dff6-495e-b620-64c7880a199e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:16.743030 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133b13-dff6-495e-b620-64c7880a199e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:16.762622 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a5133b13-dff6-495e-b620-64c7880a199e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:16.763796 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a5133b13-dff6-495e-b620-64c7880a199e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:16.819537 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1441/2877] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:16.829689 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:16.831114 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:16.889967 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acc838-db13-467c-8fbf-ceb18c47c899 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:16.893618 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99b94-b8a0-4c18-9bfe-0c4d827cdaa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:16.894217 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99b94-b8a0-4c18-9bfe-0c4d827cdaa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:16.894493 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99b94-b8a0-4c18-9bfe-0c4d827cdaa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:16.894763 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99b94-b8a0-4c18-9bfe-0c4d827cdaa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:16.901737 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:16.904103 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99b94-b8a0-4c18-9bfe-0c4d827cdaa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:16.905698 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99b94-b8a0-4c18-9bfe-0c4d827cdaa7 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:16.916885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1437/2878] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:17.183264 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133b13-dff6-495e-b620-64c7880a199e None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:17.184754 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a5133b13-dff6-495e-b620-64c7880a199e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:17.198207 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133b13-dff6-495e-b620-64c7880a199e None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:17.203265 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:17.203913 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:17.204191 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:17.204473 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] PATH_INFO: `/v3/projects/2846a4b941b1469cbbc28778dd72175f` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:17.205733 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2846a4b941b1469cbbc28778dd72175f)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:17.207860 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:17.233945 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:17.255878 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2846a4b941b1469cbbc28778dd72175f', 'request_id': 'req-69df12fe-94f7-4030-9422-aeef2fe16e34'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.262219 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2846a4b941b1469cbbc28778dd72175f', 'request_id': 'req-69df12fe-94f7-4030-9422-aeef2fe16e34'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.269048 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2846a4b941b1469cbbc28778dd72175f', 'request_id': 'req-69df12fe-94f7-4030-9422-aeef2fe16e34'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.280497 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] The token cache is being invalidate because project 2846a4b941b1469cbbc28778dd72175f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:31:17.280808 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.281422 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.282884 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1442/2879] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:31:17 2022] DELETE /identity/v3/projects/2846a4b941b1469cbbc28778dd72175f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:17.286844 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99b94-b8a0-4c18-9bfe-0c4d827cdaa7 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:17.296648 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99b94-b8a0-4c18-9bfe-0c4d827cdaa7 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:17.352932 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:17.353563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:17.353838 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:17.354104 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] PATH_INFO: `/v3/users/b2b07878b21e4f10b57f60942921d5f9` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:17.355210 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2b07878b21e4f10b57f60942921d5f9)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:17.357143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:17.403036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b07878b21e4f10b57f60942921d5f9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.410195 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b07878b21e4f10b57f60942921d5f9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.410864 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b07878b21e4f10b57f60942921d5f9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.411474 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b07878b21e4f10b57f60942921d5f9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.419625 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-7d8dff16-fee3-4df2-9e65-dd51fac7c94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b07878b21e4f10b57f60942921d5f9'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.438589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1438/2880] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:31:17 2022] DELETE /identity/v3/users/b2b07878b21e4f10b57f60942921d5f9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:17.709548 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:17.711006 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:17.725162 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df12fe-94f7-4030-9422-aeef2fe16e34 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:17.783798 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:17.784414 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:17.784638 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:17.784930 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] PATH_INFO: `/v3/projects/e2306aa4c4174391abc23a20c4d4ac67` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:17.786040 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2306aa4c4174391abc23a20c4d4ac67)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:17.787946 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:17.834732 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2306aa4c4174391abc23a20c4d4ac67', 'request_id': 'req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.840206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2306aa4c4174391abc23a20c4d4ac67', 'request_id': 'req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.847488 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2306aa4c4174391abc23a20c4d4ac67', 'request_id': 'req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.858299 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] The token cache is being invalidate because project e2306aa4c4174391abc23a20c4d4ac67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:31:17.858583 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.859206 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-c50ad417-aec8-45f8-b5fa-fd815c1e20fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:17.860687 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1443/2881] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:31:17 2022] DELETE /identity/v3/projects/e2306aa4c4174391abc23a20c4d4ac67 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:17.866536 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1656649-5dcb-422d-aba7-dacd59bcf6fd None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:17.867035 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1656649-5dcb-422d-aba7-dacd59bcf6fd None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:17.867160 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1656649-5dcb-422d-aba7-dacd59bcf6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:17.887156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-f1656649-5dcb-422d-aba7-dacd59bcf6fd None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:17.888349 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f1656649-5dcb-422d-aba7-dacd59bcf6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:17.945794 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1439/2882] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:17.954745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbef6b-3568-4f14-8071-480910a75ca7 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:17.955019 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbef6b-3568-4f14-8071-480910a75ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:17.955283 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbef6b-3568-4f14-8071-480910a75ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:17.974882 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-82bbef6b-3568-4f14-8071-480910a75ca7 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:17.976062 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-82bbef6b-3568-4f14-8071-480910a75ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:17.985214 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1444/2883] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:17.988971 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1656649-5dcb-422d-aba7-dacd59bcf6fd None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:17.999638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1656649-5dcb-422d-aba7-dacd59bcf6fd None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:18.004187 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ef76f-4eb1-46ae-ad3a-1d9752d9b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:18.004797 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ef76f-4eb1-46ae-ad3a-1d9752d9b908 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:18.005076 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ef76f-4eb1-46ae-ad3a-1d9752d9b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:18.005346 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ef76f-4eb1-46ae-ad3a-1d9752d9b908 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:18.005982 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ef76f-4eb1-46ae-ad3a-1d9752d9b908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:31:18.006280 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ef76f-4eb1-46ae-ad3a-1d9752d9b908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:18.007855 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ef76f-4eb1-46ae-ad3a-1d9752d9b908 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:18.019348 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1440/2884] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:31:18.025645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbef6b-3568-4f14-8071-480910a75ca7 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:18.035341 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbef6b-3568-4f14-8071-480910a75ca7 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:18.039805 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a30e-b808-4510-bda2-c31ef3584983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:18.040969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a30e-b808-4510-bda2-c31ef3584983 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:18.041245 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a30e-b808-4510-bda2-c31ef3584983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:18.041511 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a30e-b808-4510-bda2-c31ef3584983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:18.042132 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a30e-b808-4510-bda2-c31ef3584983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:18.044018 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a30e-b808-4510-bda2-c31ef3584983 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:18.072655 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1445/2885] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:31:18 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:31:18.076915 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ef76f-4eb1-46ae-ad3a-1d9752d9b908 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:18.082200 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:18.089256 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ef76f-4eb1-46ae-ad3a-1d9752d9b908 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:18.145316 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc38bbf-5fcd-453d-b0fa-2494e68354b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:18.145913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38bbf-5fcd-453d-b0fa-2494e68354b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:18.146190 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38bbf-5fcd-453d-b0fa-2494e68354b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:18.146462 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38bbf-5fcd-453d-b0fa-2494e68354b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:18.147085 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc38bbf-5fcd-453d-b0fa-2494e68354b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:18.149016 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc38bbf-5fcd-453d-b0fa-2494e68354b4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:18.170299 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1441/2886] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:31:18 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:31:18.174430 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a30e-b808-4510-bda2-c31ef3584983 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:18.184996 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a30e-b808-4510-bda2-c31ef3584983 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:18.189504 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41b6f-b66c-49a6-876d-b7f3360252f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:18.190095 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41b6f-b66c-49a6-876d-b7f3360252f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:18.190369 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41b6f-b66c-49a6-876d-b7f3360252f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:18.190657 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41b6f-b66c-49a6-876d-b7f3360252f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:18.191285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c41b6f-b66c-49a6-876d-b7f3360252f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:18.192910 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c41b6f-b66c-49a6-876d-b7f3360252f5 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:18.203163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1446/2887] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:31:18.207116 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc38bbf-5fcd-453d-b0fa-2494e68354b4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:18.217658 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc38bbf-5fcd-453d-b0fa-2494e68354b4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:18.222207 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a81344-0631-4fd9-8819-bbe0a92d0ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:18.222791 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a81344-0631-4fd9-8819-bbe0a92d0ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:18.223156 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a81344-0631-4fd9-8819-bbe0a92d0ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:18.223432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a81344-0631-4fd9-8819-bbe0a92d0ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:18.224063 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a81344-0631-4fd9-8819-bbe0a92d0ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:18.225769 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a81344-0631-4fd9-8819-bbe0a92d0ffe admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:18.236341 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1442/2888] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:31:18.240330 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41b6f-b66c-49a6-876d-b7f3360252f5 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:18.245728 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:18.252074 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41b6f-b66c-49a6-876d-b7f3360252f5 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:18.257800 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40ab9c-79d6-4dd0-adb5-03e87c52d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:18.258472 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ab9c-79d6-4dd0-adb5-03e87c52d753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:18.259260 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ab9c-79d6-4dd0-adb5-03e87c52d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:18.259527 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ab9c-79d6-4dd0-adb5-03e87c52d753 admin admin] PATH_INFO: `/v3/projects/5e208cd25134464bb7bcc5165e8564f2/users/6c1204daab66450da039e76f04771f9f/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:18.274234 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40ab9c-79d6-4dd0-adb5-03e87c52d753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e208cd25134464bb7bcc5165e8564f2, user_id=6c1204daab66450da039e76f04771f9f, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:18.277645 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40ab9c-79d6-4dd0-adb5-03e87c52d753 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:18.289742 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1447/2889] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:31:18 2022] PUT /identity/v3/projects/5e208cd25134464bb7bcc5165e8564f2/users/6c1204daab66450da039e76f04771f9f/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:18.300881 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f1af1-f74e-409a-a222-8de4c6121f00 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:18.301167 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f1af1-f74e-409a-a222-8de4c6121f00 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:18.301440 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f1af1-f74e-409a-a222-8de4c6121f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:18.330025 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7b7f1af1-f74e-409a-a222-8de4c6121f00 None None] MFA Rules not processed for user `6c1204daab66450da039e76f04771f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:18.331213 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7b7f1af1-f74e-409a-a222-8de4c6121f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:18.394106 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1443/2890] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:18.406152 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40ab9c-79d6-4dd0-adb5-03e87c52d753 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:18.407845 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-5d40ab9c-79d6-4dd0-adb5-03e87c52d753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:18.465355 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40ab9c-79d6-4dd0-adb5-03e87c52d753 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:18.469077 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9401b81-417f-494c-bb5d-79487384c19e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b215bfb43742678bd5a728973dbc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:18.469672 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9401b81-417f-494c-bb5d-79487384c19e service cinder] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:18.469955 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9401b81-417f-494c-bb5d-79487384c19e service cinder] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:18.470224 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9401b81-417f-494c-bb5d-79487384c19e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:18.479115 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9401b81-417f-494c-bb5d-79487384c19e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:18.480543 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9401b81-417f-494c-bb5d-79487384c19e service cinder] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:18.489291 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1448/2891] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:28.391284 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:28.485340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:29.860535 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f1af1-f74e-409a-a222-8de4c6121f00 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:29.926934 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f1af1-f74e-409a-a222-8de4c6121f00 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:29.931655 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:29.932278 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:29.932555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:29.932859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] PATH_INFO: `/v3/users/6c1204daab66450da039e76f04771f9f` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:29.933972 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c1204daab66450da039e76f04771f9f)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:29.935873 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:29.981513 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c1204daab66450da039e76f04771f9f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:29.988279 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c1204daab66450da039e76f04771f9f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:29.988913 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c1204daab66450da039e76f04771f9f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:29.989521 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c1204daab66450da039e76f04771f9f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:29.997142 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c1204daab66450da039e76f04771f9f'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:30.014563 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1444/2892] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:31:29 2022] DELETE /identity/v3/users/6c1204daab66450da039e76f04771f9f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:30.019037 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b54e-0fac-45b6-919c-890078e3765e None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.019528 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b54e-0fac-45b6-919c-890078e3765e None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.019636 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b54e-0fac-45b6-919c-890078e3765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.038891 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-11b5b54e-0fac-45b6-919c-890078e3765e None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:30.040304 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-11b5b54e-0fac-45b6-919c-890078e3765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:30.098540 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1449/2893] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:30.108125 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:30.109589 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:30.166102 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c2ffc-cca6-4b1e-897f-42589fd1f580 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:30.170030 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10e48c-1faf-44b4-9af8-6890a61e4188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:30.170628 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10e48c-1faf-44b4-9af8-6890a61e4188 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.170905 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10e48c-1faf-44b4-9af8-6890a61e4188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.171175 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10e48c-1faf-44b4-9af8-6890a61e4188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.180159 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10e48c-1faf-44b4-9af8-6890a61e4188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:30.181638 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10e48c-1faf-44b4-9af8-6890a61e4188 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:30.191047 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1445/2894] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:30.455605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5b54e-0fac-45b6-919c-890078e3765e None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:30.457118 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-11b5b54e-0fac-45b6-919c-890078e3765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:30.473403 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5b54e-0fac-45b6-919c-890078e3765e None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:30.479491 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:30.480150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.480380 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.480686 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] PATH_INFO: `/v3/projects/5e208cd25134464bb7bcc5165e8564f2` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.481810 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e208cd25134464bb7bcc5165e8564f2)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:30.483722 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:30.530313 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e208cd25134464bb7bcc5165e8564f2', 'request_id': 'req-6b7573a0-6983-41b8-a811-e5e6ed810229'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:30.535871 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e208cd25134464bb7bcc5165e8564f2', 'request_id': 'req-6b7573a0-6983-41b8-a811-e5e6ed810229'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:30.543328 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e208cd25134464bb7bcc5165e8564f2', 'request_id': 'req-6b7573a0-6983-41b8-a811-e5e6ed810229'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:30.554542 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] The token cache is being invalidate because project 5e208cd25134464bb7bcc5165e8564f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:31:30.554881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:30.555956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-6b7573a0-6983-41b8-a811-e5e6ed810229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:30.557479 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1450/2895] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:31:30 2022] DELETE /identity/v3/projects/5e208cd25134464bb7bcc5165e8564f2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:31:30.562364 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509a2a4-7f29-4f0d-86f7-4e5503321b70 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.562652 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509a2a4-7f29-4f0d-86f7-4e5503321b70 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.562927 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509a2a4-7f29-4f0d-86f7-4e5503321b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.582470 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-7509a2a4-7f29-4f0d-86f7-4e5503321b70 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:30.583665 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-7509a2a4-7f29-4f0d-86f7-4e5503321b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:30.600247 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:30.644641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1446/2896] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:30.653083 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095258-2fbc-46e7-b671-1961d9b11547 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.653366 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095258-2fbc-46e7-b671-1961d9b11547 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.653635 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095258-2fbc-46e7-b671-1961d9b11547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.674052 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-85095258-2fbc-46e7-b671-1961d9b11547 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:30.675249 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-85095258-2fbc-46e7-b671-1961d9b11547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:30.683617 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1451/2897] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:30.687885 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509a2a4-7f29-4f0d-86f7-4e5503321b70 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:30.698038 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509a2a4-7f29-4f0d-86f7-4e5503321b70 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:30.702524 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e8bc4-3ebf-45d1-8eac-c1027d5b0f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:30.703211 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e8bc4-3ebf-45d1-8eac-c1027d5b0f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.703488 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e8bc4-3ebf-45d1-8eac-c1027d5b0f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.703756 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e8bc4-3ebf-45d1-8eac-c1027d5b0f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.704393 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e8bc4-3ebf-45d1-8eac-c1027d5b0f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:31:30.704725 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e8bc4-3ebf-45d1-8eac-c1027d5b0f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:30.706340 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e8bc4-3ebf-45d1-8eac-c1027d5b0f11 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:30.717961 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1447/2898] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Aug 9 12:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:31:30.722103 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85095258-2fbc-46e7-b671-1961d9b11547 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:30.732745 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85095258-2fbc-46e7-b671-1961d9b11547 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:30.737890 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09dba2-d98a-4616-8000-5bb1c66185a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:30.738568 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09dba2-d98a-4616-8000-5bb1c66185a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.738909 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09dba2-d98a-4616-8000-5bb1c66185a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.739177 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09dba2-d98a-4616-8000-5bb1c66185a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.739804 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09dba2-d98a-4616-8000-5bb1c66185a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:30.741734 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09dba2-d98a-4616-8000-5bb1c66185a2 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:30.777603 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1452/2899] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Aug 9 12:31:30 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:31:30.781859 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e8bc4-3ebf-45d1-8eac-c1027d5b0f11 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:30.792676 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e8bc4-3ebf-45d1-8eac-c1027d5b0f11 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:30.847433 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1db504-8080-42ba-b923-600e19d43ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:30.847949 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1db504-8080-42ba-b923-600e19d43ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.848225 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1db504-8080-42ba-b923-600e19d43ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.848496 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1db504-8080-42ba-b923-600e19d43ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.849143 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1db504-8080-42ba-b923-600e19d43ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:30.851036 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1db504-8080-42ba-b923-600e19d43ba4 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:30.873615 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1448/2900] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Aug 9 12:31:30 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:31:30.877730 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09dba2-d98a-4616-8000-5bb1c66185a2 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:30.887864 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09dba2-d98a-4616-8000-5bb1c66185a2 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:30.892439 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62776c6c-a996-4923-85e7-ace02eb9ee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:30.893061 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62776c6c-a996-4923-85e7-ace02eb9ee75 admin admin] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.893347 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62776c6c-a996-4923-85e7-ace02eb9ee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.893605 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62776c6c-a996-4923-85e7-ace02eb9ee75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.894235 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62776c6c-a996-4923-85e7-ace02eb9ee75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:30.895823 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62776c6c-a996-4923-85e7-ace02eb9ee75 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:30.905956 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1453/2901] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:31:30.909736 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1db504-8080-42ba-b923-600e19d43ba4 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:30.920343 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1db504-8080-42ba-b923-600e19d43ba4 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:30.924965 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82693b5c-247f-4e9b-a2ed-8d12e5c7432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:30.925555 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82693b5c-247f-4e9b-a2ed-8d12e5c7432c admin admin] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.925831 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82693b5c-247f-4e9b-a2ed-8d12e5c7432c admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.926101 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82693b5c-247f-4e9b-a2ed-8d12e5c7432c admin admin] PATH_INFO: `/v3/roles` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.926731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82693b5c-247f-4e9b-a2ed-8d12e5c7432c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:30.928309 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82693b5c-247f-4e9b-a2ed-8d12e5c7432c admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:30.939463 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1449/2902] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 9 12:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:31:30.943461 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62776c6c-a996-4923-85e7-ace02eb9ee75 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:30.953415 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62776c6c-a996-4923-85e7-ace02eb9ee75 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:30.957969 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1e28c-e789-48a2-87db-62a19df9d533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:30.958600 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1e28c-e789-48a2-87db-62a19df9d533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:30.958881 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1e28c-e789-48a2-87db-62a19df9d533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:30.959150 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1e28c-e789-48a2-87db-62a19df9d533 admin admin] PATH_INFO: `/v3/projects/43d1301c3e194db9a1cc821b9bc2b6e2/users/2c847d3c30854135be4fbce43e08a9de/roles/12dc9c7d75da4722bf4525a56eea0e47` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:30.973596 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1e28c-e789-48a2-87db-62a19df9d533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d1301c3e194db9a1cc821b9bc2b6e2, user_id=2c847d3c30854135be4fbce43e08a9de, role_id=12dc9c7d75da4722bf4525a56eea0e47)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:30.976262 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1e28c-e789-48a2-87db-62a19df9d533 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:30.989229 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1454/2903] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Aug 9 12:31:30 2022] PUT /identity/v3/projects/43d1301c3e194db9a1cc821b9bc2b6e2/users/2c847d3c30854135be4fbce43e08a9de/roles/12dc9c7d75da4722bf4525a56eea0e47 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:31.001321 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a524c3-89d1-46c8-b1b0-509608531e44 None None] REQUEST_METHOD: `POST` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:31.001605 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a524c3-89d1-46c8-b1b0-509608531e44 None None] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:31.001876 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a524c3-89d1-46c8-b1b0-509608531e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:31.028884 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.auth.core [None req-27a524c3-89d1-46c8-b1b0-509608531e44 None None] MFA Rules not processed for user `2c847d3c30854135be4fbce43e08a9de`. Rule list: `[]` (Enabled: `True`). {{(pid=80085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:31.030083 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-27a524c3-89d1-46c8-b1b0-509608531e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:31.093458 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1450/2904] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:31.106076 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1e28c-e789-48a2-87db-62a19df9d533 admin admin] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:31.108124 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a4f1e28c-e789-48a2-87db-62a19df9d533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:31.122340 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:31.169285 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1e28c-e789-48a2-87db-62a19df9d533 admin admin] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:31.173134 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddac0f-e96c-42b0-8a1a-7261cdfca3ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79efccae1afa46e78c25f617bf2dd9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:31.173748 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddac0f-e96c-42b0-8a1a-7261cdfca3ef service glance] REQUEST_METHOD: `GET` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:31.174003 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddac0f-e96c-42b0-8a1a-7261cdfca3ef service glance] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:31.174266 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddac0f-e96c-42b0-8a1a-7261cdfca3ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:31.182612 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddac0f-e96c-42b0-8a1a-7261cdfca3ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:31.184033 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddac0f-e96c-42b0-8a1a-7261cdfca3ef service glance] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:31.192611 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1455/2905] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:41.090432 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:41.188740 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=21 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:53.946455 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a524c3-89d1-46c8-b1b0-509608531e44 None None] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:54.010342 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a524c3-89d1-46c8-b1b0-509608531e44 None None] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:54.014861 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:54.015477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:54.015754 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:54.016023 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] PATH_INFO: `/v3/users/2c847d3c30854135be4fbce43e08a9de` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:54.017152 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c847d3c30854135be4fbce43e08a9de)` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:54.019061 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:54.066469 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c847d3c30854135be4fbce43e08a9de'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:54.073226 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c847d3c30854135be4fbce43e08a9de'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:54.073875 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c847d3c30854135be4fbce43e08a9de'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:54.074477 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c847d3c30854135be4fbce43e08a9de'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:54.081636 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.notifications [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c847d3c30854135be4fbce43e08a9de'} {{(pid=80085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:54.098550 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1451/2906] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 9 12:31:53 2022] DELETE /identity/v3/users/2c847d3c30854135be4fbce43e08a9de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:31:54.102978 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915df2e-9655-4dbe-8f5f-4ee3c45571a9 None None] REQUEST_METHOD: `POST` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:54.103477 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915df2e-9655-4dbe-8f5f-4ee3c45571a9 None None] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:54.103586 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915df2e-9655-4dbe-8f5f-4ee3c45571a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:54.122834 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.auth.core [None req-a915df2e-9655-4dbe-8f5f-4ee3c45571a9 None None] MFA Rules not processed for user `3854e1394dc743bfbab4ce7b02389426`. Rule list: `[]` (Enabled: `True`). {{(pid=80086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:54.124640 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a915df2e-9655-4dbe-8f5f-4ee3c45571a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:54.181727 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1456/2907] 10.222.0.25 () {58 vars in 958 bytes} [Tue Aug 9 12:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:54.191924 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:54.193366 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:54.250874 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121c456-569e-470e-b78a-882bccdbee40 admin admin] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:54.254501 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f648-4955-4ec6-a16e-2cc4af2068d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13063cbf860c4ca98666500c3c125933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:54.255096 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f648-4955-4ec6-a16e-2cc4af2068d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:54.255373 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f648-4955-4ec6-a16e-2cc4af2068d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:54.255641 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f648-4955-4ec6-a16e-2cc4af2068d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:54.264579 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2f648-4955-4ec6-a16e-2cc4af2068d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:54.266022 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2f648-4955-4ec6-a16e-2cc4af2068d7 service neutron] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:54.275365 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1452/2908] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:54.543830 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915df2e-9655-4dbe-8f5f-4ee3c45571a9 None None] Authenticating user token {{(pid=80086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:54.545534 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.fernet_utils [None req-a915df2e-9655-4dbe-8f5f-4ee3c45571a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:54.559225 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915df2e-9655-4dbe-8f5f-4ee3c45571a9 None None] Validating token access rules against request {{(pid=80086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:54.565226 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3854e1394dc743bfbab4ce7b02389426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95743c69ba944a32817628bc182e9a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:54.565892 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:54.566163 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:54.566432 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] PATH_INFO: `/v3/projects/43d1301c3e194db9a1cc821b9bc2b6e2` {{(pid=80086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:54.567563 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d1301c3e194db9a1cc821b9bc2b6e2)` {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:54.569506 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] RBAC: Authorization granted {{(pid=80086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:54.615168 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d1301c3e194db9a1cc821b9bc2b6e2', 'request_id': 'req-2f9c274c-8697-4e21-b0c7-4a67c005d981'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:54.620517 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d1301c3e194db9a1cc821b9bc2b6e2', 'request_id': 'req-2f9c274c-8697-4e21-b0c7-4a67c005d981'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:54.628397 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d1301c3e194db9a1cc821b9bc2b6e2', 'request_id': 'req-2f9c274c-8697-4e21-b0c7-4a67c005d981'} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:54.639215 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] The token cache is being invalidate because project 43d1301c3e194db9a1cc821b9bc2b6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:31:54.639507 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:54.640157 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG keystone.notifications [None req-2f9c274c-8697-4e21-b0c7-4a67c005d981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:31:54.641650 dv-cinder-852369-1-smb devstack@keystone.service[80086]: [pid: 80086|app: 0|req: 1457/2909] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 9 12:31:54 2022] DELETE /identity/v3/projects/43d1301c3e194db9a1cc821b9bc2b6e2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:04.271293 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:04.636286 dv-cinder-852369-1-smb devstack@keystone.service[80086]: DEBUG dbcounter [-] [80086] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:49.276900 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f648-4955-4ec6-a16e-2cc4af2068d7 service neutron] Authenticating user token {{(pid=80085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:49.278292 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-5ee2f648-4955-4ec6-a16e-2cc4af2068d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:49.346722 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f648-4955-4ec6-a16e-2cc4af2068d7 service neutron] Validating token access rules against request {{(pid=80085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:49.405786 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419a224-bc09-41e6-8abc-9c59795e31a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f2e22ace8648919104c910c74c1711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50132e2ee6734b119ec58f32acdc3add', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:49.406423 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419a224-bc09-41e6-8abc-9c59795e31a5 service placement] REQUEST_METHOD: `GET` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:49.406703 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419a224-bc09-41e6-8abc-9c59795e31a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:49.406976 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419a224-bc09-41e6-8abc-9c59795e31a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:49.408731 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.fernet_utils [None req-e419a224-bc09-41e6-8abc-9c59795e31a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:49.420788 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419a224-bc09-41e6-8abc-9c59795e31a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:49.422374 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419a224-bc09-41e6-8abc-9c59795e31a5 service placement] RBAC: Authorization granted {{(pid=80085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:49.434198 dv-cinder-852369-1-smb devstack@keystone.service[80085]: [pid: 80085|app: 0|req: 1453/2910] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:59.429065 dv-cinder-852369-1-smb devstack@keystone.service[80085]: DEBUG dbcounter [-] [80085] Writing DB stats keystone:SELECT=58 {{(pid=80085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}